Sep 08 16:25:39 devstack cinder-volume[76470]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 08 16:25:39 devstack cinder-volume[76470]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 08 16:25:39 devstack cinder-volume[76470]: we strongly recommend against using it for new projects.
Sep 08 16:25:39 devstack cinder-volume[76470]: If you are already using Eventlet, we recommend migrating to a different
Sep 08 16:25:39 devstack cinder-volume[76470]: framework.  For more detail see
Sep 08 16:25:39 devstack cinder-volume[76470]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 08 16:25:39 devstack cinder-volume[76470]:   import eventlet  # noqa
Sep 08 16:25:42 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 08 16:25:42 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 08 16:25:42 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 08 16:25:43 devstack cinder-volume[76470]: INFO dbcounter [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Registered counter for database cinder
Sep 08 16:25:43 devstack cinder-volume[76470]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:25:44 devstack cinder-volume[76470]: DEBUG dbcounter [-] [76470] Writer thread running {{(pid=76470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 08 16:25:44 devstack cinder-volume[76470]: INFO cinder.rpc [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 08 16:25:44 devstack cinder-volume[76470]: INFO cinder.rpc [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 08 16:25:44 devstack cinder-volume[76470]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:25:44 devstack cinder-volume[76470]: INFO cinder.volume.manager [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Determined volume DB was empty at startup.
Sep 08 16:25:44 devstack cinder-volume[76470]: DEBUG cinder.volume.manager [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76470) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 08 16:25:44 devstack cinder-volume[76470]: INFO cinder.volume.manager [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 08 16:25:44 devstack cinder-volume[76470]: WARNING stevedore.named [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 08 16:25:44 devstack cinder-volume[76470]: WARNING castellan.key_manager [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 08 16:25:44 devstack cinder-volume[76470]: WARNING cinder.keymgr.conf_key_mgr [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 08 16:25:44 devstack cinder-volume[76470]: DEBUG cinder.volume.drivers.lvm [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76470) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 08 16:25:44 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:44 devstack cinder-volume[76470]: DEBUG oslo_concurrency.processutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.531s {{(pid=76470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:25:45 devstack cinder-volume[76470]: INFO cinder.rpc [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 08 16:25:45 devstack cinder-volume[76470]: INFO cinder.rpc [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 08 16:25:45 devstack cinder-volume[76470]: WARNING stevedore.named [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 08 16:25:45 devstack cinder-volume[76470]: WARNING castellan.key_manager [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 08 16:25:45 devstack cinder-volume[76470]: INFO cinder.volume.manager [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_db.sqlalchemy.engines [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:25:45 devstack cinder-volume[76470]: INFO oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Starting 1 workers
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Started child 76753 {{(pid=76470) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Full set of CONF: {{(pid=76470) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] ******************************************************************************** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Configuration options gathered from: {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] ================================================================================ {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] allow_availability_zone_fallback = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] allow_compression_on_image_upload = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] allowed_direct_url_schemes     = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] api_rate_limit                 = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] auth_strategy                  = keystone {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] az_cache_duration              = 3600 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_availability_zone      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_host                   = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_name                   = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_stats_polling_interval = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backup_api_class               = cinder.backup.api.API {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backup_name_template           = backup-%s {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backup_use_same_host           = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backup_use_temp_snapshot       = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] chap_password                  = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] chap_username                  =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_internal_tenant_project_id = c483035b610243f8b11a2753b74eda52 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_internal_tenant_user_id = b13f9f64102448b79058f088dffdf743 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cloned_volume_same_az          = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cluster                        = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] compression_format             = gzip {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] config_dir                     = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] config_source                  = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] control_exchange               = openstack {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] debug                          = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] default_availability_zone      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] default_group_type             = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] default_volume_type            = lvmdriver-1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] disk_geometry                  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] driver_client_cert             = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] driver_client_cert_key         = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] driver_data_namespace          = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] driver_ssl_cert_path           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] driver_ssl_cert_verify         = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] driver_use_ssl                 = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] enable_force_upload            = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] enable_new_services            = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] enable_unsupported_driver      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] enforce_multipath_for_image_xfer = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] filter_function                = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_api_insecure            = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_api_ssl_compression     = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_ca_certificates_file    = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_certfile                = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76753]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_keyfile                 = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_num_retries             = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance_request_timeout         = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] goodness_function              = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] graceful_shutdown_timeout      = 5 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] group_api_class                = cinder.group.api.API {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] host                           = devstack {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_compress_on_upload       = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_conversion_address_space_limit = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_conversion_cpu_limit     = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_conversion_disable       = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_upload_use_cinder_backend = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_upload_use_internal_tenant = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_volume_cache_enabled     = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_volume_cache_max_count   = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] image_volume_cache_max_size_gb = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] init_host_max_objects_retrieval = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] iscsi_target_flags             =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] iscsi_write_cache              = on {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] iser_helper                    = tgtadm {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] iser_ip_address                = 192.168.122.53 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] iser_port                      = 3260 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_color                      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_config_append              = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_dir                        = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_file                       = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_options                    = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_rotate_interval            = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_rotate_interval_type       = days {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] log_rotation_type              = none {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] max_age                        = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] max_logfile_count              = 30 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] max_logfile_size_mb            = 200 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] max_over_subscription_ratio    = 20.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] message_reap_interval          = 86400 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] message_ttl                    = 2592000 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] migration_create_volume_timeout_secs = 300 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] monkey_patch                   = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] monkey_patch_modules           = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] my_ip                          = 192.168.122.53 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] no_snapshot_gb_quota           = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] num_iser_scan_tries            = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] num_shell_tries                = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] num_volume_device_scan_tries   = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] nvmeof_conn_info_version       = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] nvmet_ns_id                    = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] nvmet_port_id                  = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] osapi_max_limit                = 1000 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] osapi_volume_ext_list          = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] osapi_volume_listen_port       = 8776 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] osapi_volume_use_ssl           = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] osapi_volume_workers           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] per_volume_size_limit          = -1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] periodic_fuzzy_delay           = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] periodic_interval              = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] public_endpoint                = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] publish_errors                 = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] quota_backup_gigabytes         = 1000 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] quota_backups                  = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] quota_gigabytes                = 1000 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] quota_groups                   = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] quota_snapshots                = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] quota_volumes                  = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] rate_limit_burst               = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] rate_limit_except_level        = CRITICAL {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] rate_limit_interval            = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] reinit_driver_count            = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] replication_device             = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] report_discard_supported       = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] report_interval                = 120 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] reservation_clean_interval     = 86400 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] reservation_expire             = 86400 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] reserved_image_namespaces      = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] reserved_percentage            = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] rpc_response_timeout           = 120 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] run_external_periodic_tasks    = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] scst_target_driver             = iscsi {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] scst_target_iqn_name           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_down_time              = 720 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] shell_completion               = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] snapshot_name_template         = snapshot-%s {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] snapshot_same_host             = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] split_loggers                  = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] state_path                     = /opt/stack/data/cinder {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] storage_availability_zone      = nova {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] storage_protocol               = iSCSI {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] syslog_log_facility            = LOG_USER {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] target_helper                  = lioadm {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] target_ip_address              = 192.168.122.53 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] target_port                    = 3260 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] target_protocol                = iscsi {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] target_secondary_ip_addresses  = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] trace_flags                    = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] transport_url                  = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] until_refresh                  = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] use_chap_auth                  = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76753]: INFO cinder.volume.manager [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] use_default_quota_class        = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] use_journal                    = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] use_json                       = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] use_multipath_for_image_xfer   = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] use_stderr                     = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] use_syslog                     = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] verify_glance_signatures       = enabled {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_api_class               = cinder.volume.api.API {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_backend_name            = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_clear                   = zero {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_clear_ionice            = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_clear_size              = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_copy_bps_limit          = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_dd_blocksize            = 1M {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_name_template           = volume-%s {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_service_inithost_offload = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volume_usage_audit_period      = month {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] zoning_mode                    = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_concurrency.disable_process_locking = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.auth_section = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.auth_type   = password {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.auth_version = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.cache       = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.certfile    = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.include_service_catalog = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.insecure    = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.interface   = public {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.keyfile     = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_password = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcache_username = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.region_name = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.service_type = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.backend                  = dogpile.cache.null {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.backend_argument         = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.backend_expiration_time  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.config_prefix            = cache.oslo {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.debug_cache_backend      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.enable_retry_client      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.enable_socket_keepalive  = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.enabled                  = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.expiration_time          = 600 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.hashclient_retry_attempts = 2 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.memcache_dead_retry      = 300 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.memcache_sasl_enabled    = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.password                 = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.proxies                  = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.redis_db                 = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.redis_server             = localhost:6379 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.retry_attempts           = 2 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.retry_delay              = 0.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.socket_keepalive_count   = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.socket_keepalive_idle    = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.socket_keepalive_interval = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.socket_timeout           = 1.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.tls_allowed_ciphers      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.tls_cafile               = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.tls_certfile             = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.tls_enabled              = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.tls_keyfile              = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cache.username                 = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] coordination.backend_url       = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.asyncio_connection    = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.asyncio_slave_connection = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.backend               = sqlalchemy {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.connection            = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.connection_debug      = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.connection_parameters =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.connection_recycle_time = 3600 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.connection_trace      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.db_inc_retry_interval = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.db_max_retries        = 20 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.db_max_retry_interval = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.db_retry_interval     = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.max_overflow          = 50 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.max_pool_size         = 5 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.max_retries           = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.mysql_wsrep_sync_wait = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.pool_timeout          = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.retry_interval        = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.slave_connection      = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.sqlite_synchronous    = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.synchronous_reader    = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] database.use_db_reconnect      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_tracing.insecure = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.057s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.connection_string     = messaging:// {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.enabled               = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.es_doc_type           = notification {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.es_scroll_size        = 10000 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.es_scroll_time        = 2m {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.filter_error_trace    = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.hmac_keys             = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.sentinel_service_name = mymaster {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.socket_timeout        = 0.1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.trace_requests        = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler.trace_sqlalchemy      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler_jaeger.process_tags   = {} {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler_jaeger.service_name_prefix = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] profiler_otlp.service_name_prefix = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.enforce_new_defaults = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.policy_default_rule = default {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] privsep_osbrick.group          = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] privsep_osbrick.helper_command = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] privsep_osbrick.user           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_sys_admin.group         = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_sys_admin.helper_command = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] cinder_sys_admin.user          = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.auth_section      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.auth_type         = password {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.cafile            = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.certfile          = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.collect_timing    = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.insecure          = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.keyfile           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.send_service_user_token = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.split_loggers     = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.timeout           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.tls_ciphers       = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] service_user.tls_min_version   = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.auth_section            = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.auth_type               = password {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.certfile                = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.collect_timing          = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.insecure                = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.keyfile                 = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.region_name             = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.split_loggers           = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.timeout                 = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.tls_ciphers             = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] glance.tls_min_version         = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.backend_availability_zone = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.chap_password = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.chap_username =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.disk_geometry = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.driver_client_cert = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.driver_client_cert_key = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.driver_data_namespace = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.driver_use_ssl = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.extra_capabilities = {} {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.filter_function = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.goodness_function = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack sudo[76830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.iscsi_target_flags =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.iscsi_write_cache = on {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.iser_port     = 3260 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.lvm_share_target = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.lvm_type      = auto {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.num_shell_tries = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.replication_device = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.report_discard_supported = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.reserved_percentage = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.target_helper = tgtadm {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.target_port   = 3260 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.target_protocol = iscsi {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.trace_flags   = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.unique_fqdn_network = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.use_chap_auth = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_backend_name = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_clear  = zero {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_clear_ionice = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_clear_size = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_reports.file_event_handler = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_reports.log_dir           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.backend_host       = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.chap_password      = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.chap_username      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.disk_geometry      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.driver_client_cert = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.extra_capabilities = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.filter_function    = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.goodness_function  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.iser_helper        = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.iser_port          = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.lvm_type           = auto {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.replication_device = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.report_discard_supported = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.reserved_percentage = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.scst_target_driver = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.storage_protocol   = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.target_ip_address  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.target_port        = 3260 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.trace_flags        = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_clear       = zero {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] lvmdriver-1.volumes_dir        = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_notifications.driver = [] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_notifications.retry = -1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] key_manager.fixed_key          = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.barbican_api_version  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.barbican_endpoint     = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.barbican_endpoint_type = public {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.barbican_region_name  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.cafile                = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.certfile              = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.collect_timing        = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.insecure              = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.keyfile               = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.number_of_retries     = 60 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.retry_delay           = 1 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.send_service_user_token = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.split_loggers         = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.timeout               = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.tls_ciphers           = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.tls_min_version       = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.verify_ssl            = True {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican.verify_ssl_path       = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.auth_section = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.auth_type = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.cafile   = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.certfile = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.collect_timing = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.insecure = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.keyfile  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.split_loggers = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.timeout  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.tls_ciphers = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] barbican_service_user.tls_min_version = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.approle_role_id          = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.approle_secret_id        = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.auth_method              = approle {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.auth_path                = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.kv_mountpoint            = secret {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.kv_path                  = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.kv_version               = 2 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.namespace                = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.root_token_id            = **** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.ssl_ca_crt_file          = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.timeout                  = 60.0 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.token_file               = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.token_role               = None {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.use_ssl                  = False {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:25:45 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] ******************************************************************************** {{(pid=76470) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 08 16:25:45 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.401s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:45 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:45 devstack sudo[76923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:45 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:46 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.324s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:25:46 devstack cinder-volume[76753]: INFO cinder.brick.local_dev.lvm [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:46 devstack sudo[77016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:25:46 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:46 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG cinder.brick.local_dev.lvm [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76753) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 08 16:25:46 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:46 devstack sudo[77111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:46 devstack sudo[77111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:47 devstack sudo[77111]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:47 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.490s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:47 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:47 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:47 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:47 devstack sudo[77390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:47 devstack sudo[77390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:48 devstack sudo[77390]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:48 devstack sudo[77450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 08 16:25:48 devstack sudo[77450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:48 devstack sudo[77450]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.263s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:48 devstack sudo[77453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:25:48 devstack sudo[77453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:48 devstack sudo[77453]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:48 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:48 devstack sudo[77456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:25:48 devstack sudo[77456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:49 devstack sudo[77456]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:49 devstack sudo[77465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:25:49 devstack sudo[77465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:49 devstack sudo[77465]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:49 devstack sudo[77468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:49 devstack sudo[77468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:49 devstack sudo[77468]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:49 devstack sudo[77472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:49 devstack sudo[77472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:49 devstack sudo[77472]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:49 devstack cinder-volume[76753]: INFO cinder.volume.drivers.lvm [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:49 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:49 devstack sudo[77476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:49 devstack sudo[77476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:50 devstack sudo[77476]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG cinder.volume.drivers.lvm [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Updating volume stats {{(pid=76753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:50 devstack sudo[77479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:25:50 devstack sudo[77479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:50 devstack sudo[77479]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:50 devstack sudo[77484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:25:50 devstack sudo[77484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:50 devstack sudo[77484]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:50 devstack sudo[77487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:50 devstack sudo[77487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:50 devstack sudo[77487]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:50 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:50 devstack sudo[77490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:25:50 devstack sudo[77490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:51 devstack sudo[77490]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:51 devstack cinder-volume[76753]: INFO cinder.volume.driver [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Driver hasn't implemented _init_vendor_properties()
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG cinder.volume.driver [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76753) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG oslo_db.sqlalchemy.engines [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76753) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG dbcounter [-] [76753] Writer thread running {{(pid=76753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG cinder.db.api [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Building query based on filter {{(pid=76753) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG cinder.image.image_utils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76753) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 08 16:25:51 devstack cinder-volume[76753]: INFO cinder.keymgr.migration [None req-1b5570ca-b93b-467e-8995-14db309b5403 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG cinder.volume.drivers.lvm [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Updating volume stats {{(pid=76753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:51 devstack sudo[77494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:25:51 devstack sudo[77494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:51 devstack sudo[77494]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:51 devstack sudo[77498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:25:51 devstack sudo[77498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:51 devstack sudo[77498]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:51 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:51 devstack sudo[77502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:51 devstack sudo[77502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:52 devstack sudo[77502]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:52 devstack sudo[77506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:25:52 devstack sudo[77506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:52 devstack sudo[77506]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG cinder.manager [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Notifying Schedulers of capabilities ... {{(pid=76753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:25:52 devstack cinder-volume[76753]: INFO cinder.volume.manager [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Driver initialization completed successfully.
Sep 08 16:25:52 devstack cinder-volume[76753]: INFO cinder.manager [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Initiating service 2 cleanup
Sep 08 16:25:52 devstack cinder-volume[76753]: INFO cinder.manager [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Service 2 cleanup completed.
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG cinder.service [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Creating RPC server for service cinder-volume {{(pid=76753) start /opt/stack/cinder/cinder/service.py:231}}
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG cinder.service [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76753) start /opt/stack/cinder/cinder/service.py:237}}
Sep 08 16:25:52 devstack cinder-volume[76753]: INFO cinder.volume.manager [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG cinder.volume.drivers.lvm [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Updating volume stats {{(pid=76753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:52 devstack sudo[77513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:25:52 devstack sudo[77513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:52 devstack sudo[77513]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:52 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:52 devstack sudo[77516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:25:52 devstack sudo[77516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:53 devstack sudo[77516]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:53 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:53 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:53 devstack sudo[77519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:25:53 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:53 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:53 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:53 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:25:53 devstack sudo[77527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:25:53 devstack sudo[77527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:25:53 devstack sudo[77527]: pam_unix(sudo:session): session closed for user root
Sep 08 16:25:53 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:25:53 devstack cinder-volume[76753]: INFO cinder.volume.manager [None req-3de40ab5-40e9-4d66-b865-3de32b589c2c None None] Driver post RPC initialization completed successfully.
Sep 08 16:25:55 devstack cinder-volume[76470]: DEBUG dbcounter [-] [76470] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:26:02 devstack cinder-volume[76753]: DEBUG dbcounter [-] [76753] Writing DB stats cinder:SELECT=4 {{(pid=76753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:26:03 devstack cinder-volume[76753]: DEBUG dbcounter [-] [76753] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:26:17 devstack cinder-volume[76753]: DEBUG oslo_service.periodic_task [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running periodic task VolumeManager._thread_info {{(pid=76753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:26:17 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread count: 6 {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:26:17 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread info: [<_MainThread(MainThread, started 137393630027904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137393515004992)>, <Thread(Thread-3 (stat_writer), started daemon 137393516252544)>, <Thread(Rabbit-heartbeat, started daemon 137393514920768)>, <Thread(Thread-5 (_runner), started daemon 137393512745600)>, <Thread(Thread-7 (_runner), started daemon 137393512894912)>] {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:27:17 devstack cinder-volume[76753]: DEBUG oslo_service.periodic_task [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:27:17 devstack cinder-volume[76753]: DEBUG cinder.volume.drivers.lvm [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Updating volume stats {{(pid=76753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 08 16:27:17 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:27:17 devstack sudo[80165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:27:17 devstack sudo[80165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:27:18 devstack sudo[80165]: pam_unix(sudo:session): session closed for user root
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:27:18 devstack sudo[80168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:27:18 devstack sudo[80168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:27:18 devstack sudo[80168]: pam_unix(sudo:session): session closed for user root
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:27:18 devstack sudo[80171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:27:18 devstack sudo[80171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:27:18 devstack sudo[80171]: pam_unix(sudo:session): session closed for user root
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:27:18 devstack sudo[80174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:27:18 devstack sudo[80174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:27:18 devstack sudo[80174]: pam_unix(sudo:session): session closed for user root
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG cinder.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Notifying Schedulers of capabilities ... {{(pid=76753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG oslo_service.periodic_task [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running periodic task VolumeManager._thread_info {{(pid=76753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread count: 6 {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:27:18 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread info: [<_MainThread(MainThread, started 137393630027904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137393515004992)>, <Thread(Thread-3 (stat_writer), started daemon 137393516252544)>, <Thread(Rabbit-heartbeat, started daemon 137393514920768)>, <Thread(Thread-5 (_runner), started daemon 137393512745600)>, <Thread(Thread-7 (_runner), started daemon 137393512894912)>] {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:28:03 devstack cinder-volume[76753]: DEBUG dbcounter [-] [76753] Writing DB stats cinder:SELECT=1 {{(pid=76753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:28:03 devstack cinder-volume[76753]: DEBUG dbcounter [-] [76753] Writing DB stats cinder:UPDATE=1 {{(pid=76753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:28:17 devstack cinder-volume[76753]: DEBUG oslo_service.periodic_task [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:28:17 devstack cinder-volume[76753]: DEBUG cinder.volume.drivers.lvm [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Updating volume stats {{(pid=76753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 08 16:28:17 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:28:17 devstack sudo[83901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:28:17 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:28:18 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:28:18 devstack sudo[83911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:28:18 devstack sudo[83911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:28:18 devstack sudo[83911]: pam_unix(sudo:session): session closed for user root
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:28:18 devstack sudo[83923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:28:18 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:28:18 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:28:18 devstack sudo[83926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:28:18 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:28:18 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG cinder.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Notifying Schedulers of capabilities ... {{(pid=76753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG oslo_service.periodic_task [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running periodic task VolumeManager._thread_info {{(pid=76753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread count: 6 {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:28:18 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread info: [<_MainThread(MainThread, started 137393630027904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137393515004992)>, <Thread(Thread-3 (stat_writer), started daemon 137393516252544)>, <Thread(Rabbit-heartbeat, started daemon 137393514920768)>, <Thread(Thread-5 (_runner), started daemon 137393512745600)>, <Thread(Thread-7 (_runner), started daemon 137393512894912)>] {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:29:17 devstack cinder-volume[76753]: DEBUG oslo_service.periodic_task [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:29:17 devstack cinder-volume[76753]: DEBUG cinder.volume.drivers.lvm [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Updating volume stats {{(pid=76753) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 08 16:29:17 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:29:17 devstack sudo[85593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 08 16:29:17 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:29:18 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:29:18 devstack sudo[85596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:29:18 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:29:18 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:29:18 devstack sudo[85610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 08 16:29:18 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:29:18 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:29:18 devstack sudo[85613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 08 16:29:18 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:29:18 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_concurrency.processutils [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76753) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG cinder.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Notifying Schedulers of capabilities ... {{(pid=76753) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG oslo_service.periodic_task [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] Running periodic task VolumeManager._thread_info {{(pid=76753) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread count: 6 {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:29:18 devstack cinder-volume[76753]: DEBUG cinder.volume.manager [None req-a1de3a45-3c8f-466c-86d8-cae3fa322787 None None] thread info: [<_MainThread(MainThread, started 137393630027904)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137393515004992)>, <Thread(Thread-3 (stat_writer), started daemon 137393516252544)>, <Thread(Rabbit-heartbeat, started daemon 137393514920768)>, <Thread(Thread-5 (_runner), started daemon 137393512745600)>, <Thread(Thread-7 (_runner), started daemon 137393512894912)>] {{(pid=76753) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:30:03 devstack cinder-volume[76753]: DEBUG dbcounter [-] [76753] Writing DB stats cinder:SELECT=1 {{(pid=76753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:30:03 devstack cinder-volume[76753]: DEBUG dbcounter [-] [76753] Writing DB stats cinder:UPDATE=1 {{(pid=76753) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:30:04 devstack cinder-volume[76470]: INFO oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Caught SIGTERM, stopping children
Sep 08 16:30:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Acquiring lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 08 16:30:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Acquired lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 08 16:30:04 devstack cinder-volume[76470]: DEBUG oslo_concurrency.lockutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Releasing lock "singleton_lock" {{(pid=76470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 08 16:30:04 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Stop services. {{(pid=76470) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 08 16:30:04 devstack cinder-volume[76470]: DEBUG oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Killing children. {{(pid=76470) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 08 16:30:04 devstack cinder-volume[76470]: INFO oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Waiting on 1 children to exit
Sep 08 16:30:07 devstack cinder-volume[76753]: DEBUG oslo_concurrency.lockutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Acquiring lock "singleton_lock" {{(pid=76753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 08 16:30:07 devstack cinder-volume[76753]: DEBUG oslo_concurrency.lockutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Acquired lock "singleton_lock" {{(pid=76753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 08 16:30:07 devstack cinder-volume[76753]: DEBUG oslo_concurrency.lockutils [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Releasing lock "singleton_lock" {{(pid=76753) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 08 16:30:07 devstack cinder-volume[76753]: WARNING amqp [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 08 16:30:07 devstack cinder-volume[76753]: WARNING amqp [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 08 16:30:07 devstack cinder-volume[76470]: INFO oslo_service.backend._eventlet.service [None req-8eb2df83-9383-4c1c-9606-0da9cee8ffb1 None None] Child 76753 exited with status 0
Sep 08 16:30:07 devstack cinder-volume[86649]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 08 16:30:07 devstack cinder-volume[86649]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 08 16:30:07 devstack cinder-volume[86649]: we strongly recommend against using it for new projects.
Sep 08 16:30:07 devstack cinder-volume[86649]: If you are already using Eventlet, we recommend migrating to a different
Sep 08 16:30:07 devstack cinder-volume[86649]: framework.  For more detail see
Sep 08 16:30:07 devstack cinder-volume[86649]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 08 16:30:07 devstack cinder-volume[86649]:   import eventlet  # noqa
Sep 08 16:30:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 08 16:30:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 08 16:30:09 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 08 16:30:10 devstack cinder-volume[86649]: INFO dbcounter [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Registered counter for database cinder
Sep 08 16:30:10 devstack cinder-volume[86649]: DEBUG oslo_db.sqlalchemy.engines [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86649) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:10 devstack cinder-volume[86649]: DEBUG dbcounter [-] [86649] Writer thread running {{(pid=86649) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 08 16:30:10 devstack cinder-volume[86649]: INFO cinder.rpc [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 08 16:30:10 devstack cinder-volume[86649]: INFO cinder.rpc [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_db.sqlalchemy.engines [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86649) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Determined volume DB was empty at startup.
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG cinder.volume.manager [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86649) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 08 16:30:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 08 16:30:11 devstack cinder-volume[86649]: WARNING stevedore.named [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 08 16:30:11 devstack cinder-volume[86649]: WARNING castellan.key_manager [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 08 16:30:11 devstack cinder-volume[86649]: WARNING cinder.keymgr.conf_key_mgr [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 08 16:30:11 devstack cinder-volume[86649]: INFO cinder.volume.manager [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_db.sqlalchemy.engines [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86649) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:11 devstack cinder-volume[86649]: INFO oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Starting 1 workers
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Started child 86864 {{(pid=86649) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Full set of CONF: {{(pid=86649) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] ******************************************************************************** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Configuration options gathered from: {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] ================================================================================ {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] allow_availability_zone_fallback = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86864]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] allow_compression_on_image_upload = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] allowed_direct_url_schemes     = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] api_rate_limit                 = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] auth_strategy                  = keystone {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_availability_zone      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_host                   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_name                   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_stats_polling_interval = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backup_api_class               = cinder.backup.api.API {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backup_name_template           = backup-%s {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backup_use_same_host           = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backup_use_temp_snapshot       = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] chap_password                  = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] chap_username                  =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_internal_tenant_project_id = c483035b610243f8b11a2753b74eda52 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_internal_tenant_user_id = b13f9f64102448b79058f088dffdf743 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cluster                        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] compression_format             = gzip {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] compute_api_class              = cinder.compute.nova.API {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] config_dir                     = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] config_source                  = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] control_exchange               = openstack {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] debug                          = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] default_availability_zone      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] default_group_type             = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] default_volume_type            = QuobyteHD {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] disk_geometry                  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] driver_client_cert             = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] driver_client_cert_key         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] driver_data_namespace          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] driver_ssl_cert_path           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] driver_ssl_cert_verify         = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] driver_use_ssl                 = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] enable_new_services            = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] enable_unsupported_driver      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] enabled_backends               = ['QuobyteHD'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] enforce_multipath_for_image_xfer = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] filter_function                = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_api_insecure            = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_api_ssl_compression     = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_ca_certificates_file    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_catalog_info            = image:glance:publicURL {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_certfile                = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_keyfile                 = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_num_retries             = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance_request_timeout         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] goodness_function              = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] graceful_shutdown_timeout      = 5 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] group_api_class                = cinder.group.api.API {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] host                           = devstack {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_compress_on_upload       = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_conversion_address_space_limit = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86864]: INFO cinder.volume.manager [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.remotefs [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86864) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_conversion_cpu_limit     = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_conversion_disable       = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_upload_use_cinder_backend = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_upload_use_internal_tenant = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_volume_cache_enabled     = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_volume_cache_max_count   = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] image_volume_cache_max_size_gb = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] init_host_max_objects_retrieval = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] instance_format                = [instance: %(uuid)s]  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] iscsi_target_flags             =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] iscsi_write_cache              = on {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] iser_helper                    = tgtadm {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] iser_ip_address                = 192.168.122.53 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] iser_port                      = 3260 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_color                      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_config_append              = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_dir                        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_file                       = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_options                    = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_rotate_interval            = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_rotate_interval_type       = days {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] log_rotation_type              = none {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] max_age                        = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] max_logfile_count              = 30 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] max_logfile_size_mb            = 200 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] max_over_subscription_ratio    = 20.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] message_reap_interval          = 86400 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] message_ttl                    = 2592000 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] migration_create_volume_timeout_secs = 300 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] monkey_patch                   = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] monkey_patch_modules           = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] my_ip                          = 192.168.122.53 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] no_snapshot_gb_quota           = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] num_iser_scan_tries            = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] num_shell_tries                = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] num_volume_device_scan_tries   = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] nvmeof_conn_info_version       = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] nvmet_ns_id                    = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] nvmet_port_id                  = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] osapi_max_limit                = 1000 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] osapi_volume_ext_list          = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] osapi_volume_listen_port       = 8776 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] osapi_volume_use_ssl           = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] osapi_volume_workers           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] per_volume_size_limit          = -1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] periodic_fuzzy_delay           = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] periodic_interval              = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] public_endpoint                = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] publish_errors                 = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] quota_backup_gigabytes         = 1000 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] quota_backups                  = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] quota_gigabytes                = 1000 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] quota_groups                   = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] quota_snapshots                = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] quota_volumes                  = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] rate_limit_burst               = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] rate_limit_except_level        = CRITICAL {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] rate_limit_interval            = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] reinit_driver_count            = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] replication_device             = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] report_discard_supported       = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] report_interval                = 120 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] reservation_clean_interval     = 86400 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] reservation_expire             = 86400 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] reserved_image_namespaces      = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] reserved_percentage            = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] rpc_response_timeout           = 120 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] run_external_periodic_tasks    = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] scst_target_driver             = iscsi {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] scst_target_iqn_name           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_down_time              = 720 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] shell_completion               = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] snapshot_name_template         = snapshot-%s {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] split_loggers                  = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] state_path                     = /opt/stack/data/cinder {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] storage_availability_zone      = nova {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] storage_protocol               = iSCSI {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] syslog_log_facility            = LOG_USER {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] target_helper                  = lioadm {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] target_ip_address              = 192.168.122.53 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] target_port                    = 3260 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] target_protocol                = iscsi {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] target_secondary_ip_addresses  = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] trace_flags                    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] transport_url                  = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] until_refresh                  = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] use_chap_auth                  = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] use_default_quota_class        = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] use_journal                    = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] use_json                       = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] use_multipath_for_image_xfer   = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] use_stderr                     = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] use_syslog                     = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] verify_glance_signatures       = enabled {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_api_class               = cinder.volume.api.API {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_backend_name            = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_clear                   = zero {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_clear_ionice            = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_clear_size              = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86864) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 08 16:30:11 devstack cinder-volume[86864]: WARNING cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 08 16:30:11 devstack cinder-volume[86864]: WARNING cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_copy_bps_limit          = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_dd_blocksize            = 1M {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_name_template           = volume-%s {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_service_inithost_offload = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volume_usage_audit_period      = month {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] zoning_mode                    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_concurrency.disable_process_locking = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Running cmd (subprocess): mount.quobyte {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.auth_section = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.auth_type   = password {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.auth_version = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.cache       = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.certfile    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.delay_auth_decision = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.http_connect_timeout = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.include_service_catalog = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.insecure    = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.interface   = public {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.keyfile     = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_password = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcache_username = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.region_name = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.service_token_roles_required = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.service_type = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.token_cache_time = 300 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.backend                  = dogpile.cache.null {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.backend_argument         = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.backend_expiration_time  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.config_prefix            = cache.oslo {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.debug_cache_backend      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.enable_retry_client      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.enable_socket_keepalive  = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.enabled                  = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.expiration_time          = 600 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.hashclient_retry_attempts = 2 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.memcache_dead_retry      = 300 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.memcache_pool_maxsize    = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.memcache_sasl_enabled    = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.password                 = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.proxies                  = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.redis_db                 = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.redis_sentinel_service_name = mymaster {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.redis_server             = localhost:6379 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.retry_attempts           = 2 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.retry_delay              = 0.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.socket_keepalive_count   = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.socket_keepalive_idle    = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.socket_keepalive_interval = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.socket_timeout           = 1.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.tls_allowed_ciphers      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.tls_cafile               = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.tls_certfile             = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.tls_enabled              = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.tls_keyfile              = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cache.username                 = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] coordination.backend_url       = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.asyncio_connection    = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.asyncio_slave_connection = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.backend               = sqlalchemy {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.connection            = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.connection_debug      = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.connection_parameters =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.connection_recycle_time = 3600 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.connection_trace      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.db_inc_retry_interval = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.db_max_retries        = 20 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.db_max_retry_interval = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.db_retry_interval     = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.max_overflow          = 50 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.max_pool_size         = 5 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.max_retries           = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.mysql_wsrep_sync_wait = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.pool_timeout          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.retry_interval        = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.slave_connection      = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.sqlite_synchronous    = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.synchronous_reader    = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] database.use_db_reconnect      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_tracing.insecure = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.connection_string     = messaging:// {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.enabled               = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.es_doc_type           = notification {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.es_scroll_size        = 10000 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.es_scroll_time        = 2m {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.filter_error_trace    = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.hmac_keys             = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.sentinel_service_name = mymaster {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.socket_timeout        = 0.1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.trace_requests        = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack quobyte-client[86865]: Reading configuration file: /etc/quobyte/client.cfg
Sep 08 16:30:11 devstack quobyte-client[86865]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler.trace_sqlalchemy      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler_jaeger.process_tags   = {} {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler_jaeger.service_name_prefix = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] profiler_otlp.service_name_prefix = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.enforce_new_defaults = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.policy_default_rule = default {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.policy_file        = policy.yaml {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] privsep_osbrick.group          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] privsep_osbrick.helper_command = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] privsep_osbrick.user           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_sys_admin.group         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_sys_admin.helper_command = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] cinder_sys_admin.user          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.auth_section      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.auth_type         = password {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.cafile            = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.certfile          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.collect_timing    = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.insecure          = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.keyfile           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.send_service_user_token = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.split_loggers     = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=86864) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:30:11 devstack cinder-volume[86864]: INFO cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 ...
Sep 08 16:30:11 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d -c /etc/quobyte/client-cinder.cfg {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.timeout           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.tls_ciphers       = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] service_user.tls_min_version   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.auth_section            = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.auth_type               = password {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.certfile                = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.collect_timing          = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.insecure                = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.keyfile                 = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.region_name             = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.split_loggers           = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.timeout                 = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.tls_ciphers             = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] glance.tls_min_version         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.backend_availability_zone = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.chap_password = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.chap_username =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.disk_geometry = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.driver_client_cert = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.driver_client_cert_key = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.driver_data_namespace = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.driver_use_ssl = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.enable_unsupported_driver = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.extra_capabilities = {} {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.filter_function = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.goodness_function = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.iscsi_target_flags =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.iscsi_write_cache = on {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.iser_helper   = tgtadm {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.iser_port     = 3260 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_host      =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_login     = admin {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_mount_options = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_password  = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_private_key =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_share_path =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.num_shell_tries = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack sudo[86868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d -c /etc/quobyte/client-cinder.cfg
Sep 08 16:30:11 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.nvmet_port_id = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.quobyte_client_cfg = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.quobyte_volume_url = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.replication_device = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.report_discard_supported = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.reserved_percentage = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.scst_target_driver = iscsi {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.scst_target_iqn_name = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.storage_protocol = iSCSI {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.target_helper = tgtadm {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.target_port   = 3260 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.target_protocol = iscsi {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.trace_flags   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.unique_fqdn_network = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.use_chap_auth = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_backend_name = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_clear  = zero {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_clear_ionice = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_clear_size = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_reports.file_event_handler = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_reports.log_dir           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.backend_availability_zone = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.backend_host         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.chap_password        = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.chap_username        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.chiscsi_conf         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.disk_geometry        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.driver_client_cert   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.driver_client_cert_key = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.driver_data_namespace = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.driver_use_ssl       = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.extra_capabilities   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.filter_function      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.goodness_function    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.iser_helper          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.iser_ip_address      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.iser_port            = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.iser_target_prefix   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_host             = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_login            = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_mount_options    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_password         = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_private_key      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_share_path       = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_ssh_port         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.num_shell_tries      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.nvmet_port_id        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.replication_device   = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.report_discard_supported = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.reserved_percentage  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.scst_target_driver   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.storage_protocol     = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.target_helper        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.target_ip_address    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.target_port          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.target_prefix        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.target_protocol      = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.trace_flags          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.use_chap_auth        = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_clear         = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_clear_size    = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] QuobyteHD.volumes_dir          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.ssl      = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_notifications.driver = [] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_notifications.retry = -1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] oslo_messaging_notifications.transport_url = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] key_manager.fixed_key          = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.barbican_api_version  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.barbican_endpoint     = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.barbican_endpoint_type = public {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.barbican_region_name  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.cafile                = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.certfile              = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.collect_timing        = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.insecure              = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.keyfile               = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.number_of_retries     = 60 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.retry_delay           = 1 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.send_service_user_token = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.split_loggers         = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.timeout               = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.tls_ciphers           = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.tls_min_version       = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.verify_ssl            = True {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican.verify_ssl_path       = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.auth_section = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.auth_type = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.cafile   = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.certfile = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.collect_timing = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.insecure = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.keyfile  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.split_loggers = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.timeout  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.tls_ciphers = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] barbican_service_user.tls_min_version = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.approle_role_id          = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.approle_secret_id        = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.auth_method              = approle {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.auth_path                = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.kv_mountpoint            = secret {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.kv_path                  = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.kv_version               = 2 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.namespace                = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.root_token_id            = **** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.ssl_ca_crt_file          = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.timeout                  = 60.0 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.token_file               = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.token_role               = None {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.use_ssl                  = False {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:11 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] ******************************************************************************** {{(pid=86649) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 08 16:30:12 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.441s {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:12 devstack cinder-volume[86864]: INFO cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 succeeded
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=86864) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.459s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:12 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:30:12 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:12 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.254s {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:12 devstack cinder-volume[86864]: INFO cinder.volume.driver [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Driver hasn't implemented _init_vendor_properties()
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.volume.driver [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5176582336426, 'free_capacity_gb': 1773.5176582336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86864) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_db.sqlalchemy.engines [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86864) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG dbcounter [-] [86864] Writer thread running {{(pid=86864) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.db.api [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Building query based on filter {{(pid=86864) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.image.image_utils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86864) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 08 16:30:12 devstack cinder-volume[86864]: INFO cinder.keymgr.migration [None req-51fc7ff6-b4b7-4629-9044-dd3a1ea4041f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=86864) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=86864) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:12 devstack sudo[86962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:30:12 devstack sudo[86962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:12 devstack sudo[86962]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.226s {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.manager [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Notifying Schedulers of capabilities ... {{(pid=86864) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:30:12 devstack cinder-volume[86864]: INFO cinder.volume.manager [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Driver initialization completed successfully.
Sep 08 16:30:12 devstack cinder-volume[86864]: INFO cinder.manager [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Initiating service 3 cleanup
Sep 08 16:30:12 devstack cinder-volume[86864]: INFO cinder.manager [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Service 3 cleanup completed.
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.service [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Creating RPC server for service cinder-volume {{(pid=86864) start /opt/stack/cinder/cinder/service.py:231}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.service [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86864) start /opt/stack/cinder/cinder/service.py:237}}
Sep 08 16:30:12 devstack cinder-volume[86864]: INFO cinder.volume.manager [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=86864) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=86864) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:30:12 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:12 devstack sudo[86978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:30:12 devstack sudo[86978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:13 devstack sudo[86978]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:13 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.267s {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:13 devstack cinder-volume[86864]: INFO cinder.volume.manager [None req-cffe4a2b-7a6e-4651-ba25-8f8095a98b3d None None] Driver post RPC initialization completed successfully.
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=86864) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG cinder.volume.drivers.quobyte [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=86864) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86864) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:17 devstack sudo[87098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:30:17 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:17 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG oslo_concurrency.processutils [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.220s {{(pid=86864) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:17 devstack cinder-volume[86864]: DEBUG cinder.manager [None req-87694a11-780b-4fe5-ad68-34bf4fac8fab None None] Notifying Schedulers of capabilities ... {{(pid=86864) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:30:21 devstack cinder-volume[86649]: INFO oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Caught SIGTERM, stopping children
Sep 08 16:30:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Acquiring lock "singleton_lock" {{(pid=86649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 08 16:30:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Acquired lock "singleton_lock" {{(pid=86649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 08 16:30:21 devstack cinder-volume[86649]: DEBUG oslo_concurrency.lockutils [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Releasing lock "singleton_lock" {{(pid=86649) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 08 16:30:21 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Stop services. {{(pid=86649) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 08 16:30:21 devstack cinder-volume[86649]: DEBUG oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Killing children. {{(pid=86649) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 08 16:30:21 devstack cinder-volume[86649]: INFO oslo_service.backend._eventlet.service [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Waiting on 1 children to exit
Sep 08 16:30:23 devstack cinder-volume[86864]: DEBUG dbcounter [-] [86864] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86864) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:30:23 devstack cinder-volume[86864]: DEBUG dbcounter [-] [86864] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86864) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:30:26 devstack cinder-volume[86864]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 08 16:30:26 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Acquiring lock "singleton_lock" {{(pid=86864) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 08 16:30:26 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Acquired lock "singleton_lock" {{(pid=86864) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 08 16:30:26 devstack cinder-volume[86864]: DEBUG oslo_concurrency.lockutils [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Releasing lock "singleton_lock" {{(pid=86864) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 08 16:30:26 devstack cinder-volume[86864]: WARNING amqp [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 08 16:30:26 devstack cinder-volume[86864]: WARNING amqp [None req-3a35f8a9-4981-471b-bdff-ed90e320abcd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 08 16:30:26 devstack cinder-volume[87210]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 08 16:30:26 devstack cinder-volume[87210]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 08 16:30:26 devstack cinder-volume[87210]: we strongly recommend against using it for new projects.
Sep 08 16:30:26 devstack cinder-volume[87210]: If you are already using Eventlet, we recommend migrating to a different
Sep 08 16:30:26 devstack cinder-volume[87210]: framework.  For more detail see
Sep 08 16:30:26 devstack cinder-volume[87210]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 08 16:30:26 devstack cinder-volume[87210]:   import eventlet  # noqa
Sep 08 16:30:29 devstack cinder-volume[87210]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 08 16:30:29 devstack cinder-volume[87210]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 08 16:30:29 devstack cinder-volume[87210]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87210) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 08 16:30:29 devstack cinder-volume[87210]: INFO dbcounter [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Registered counter for database cinder
Sep 08 16:30:29 devstack cinder-volume[87210]: DEBUG oslo_db.sqlalchemy.engines [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG dbcounter [-] [87210] Writer thread running {{(pid=87210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 08 16:30:30 devstack cinder-volume[87210]: INFO cinder.rpc [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 08 16:30:30 devstack cinder-volume[87210]: INFO cinder.rpc [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_db.sqlalchemy.engines [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:30 devstack cinder-volume[87210]: INFO cinder.volume.manager [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Determined volume DB was empty at startup.
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG cinder.volume.manager [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87210) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 08 16:30:30 devstack cinder-volume[87210]: WARNING stevedore.named [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 08 16:30:30 devstack cinder-volume[87210]: WARNING castellan.key_manager [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 08 16:30:30 devstack cinder-volume[87210]: WARNING cinder.keymgr.conf_key_mgr [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 08 16:30:30 devstack cinder-volume[87210]: INFO cinder.volume.manager [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_db.sqlalchemy.engines [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:30 devstack cinder-volume[87210]: INFO oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Starting 1 workers
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Started child 87505 {{(pid=87210) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Full set of CONF: {{(pid=87210) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] ******************************************************************************** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] Configuration options gathered from: {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] ================================================================================ {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] allow_availability_zone_fallback = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] allow_compression_on_image_upload = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] allowed_direct_url_schemes     = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] api_rate_limit                 = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] auth_strategy                  = keystone {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_availability_zone      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_host                   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_name                   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_stats_polling_interval = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backup_api_class               = cinder.backup.api.API {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backup_name_template           = backup-%s {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backup_use_same_host           = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backup_use_temp_snapshot       = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] chap_password                  = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] chap_username                  =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_internal_tenant_project_id = c483035b610243f8b11a2753b74eda52 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_internal_tenant_user_id = b13f9f64102448b79058f088dffdf743 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cluster                        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] compression_format             = gzip {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] compute_api_class              = cinder.compute.nova.API {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] config_dir                     = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] config_source                  = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] control_exchange               = openstack {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87505]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] debug                          = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] default_availability_zone      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] default_group_type             = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] default_volume_type            = QuobyteHD {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] disk_geometry                  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] driver_client_cert             = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] driver_client_cert_key         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] driver_data_namespace          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] driver_ssl_cert_path           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] driver_ssl_cert_verify         = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] driver_use_ssl                 = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] enable_new_services            = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] enable_unsupported_driver      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] enabled_backends               = ['QuobyteHD'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] enforce_multipath_for_image_xfer = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] filter_function                = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_api_insecure            = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_api_servers             = ['http://192.168.122.53/image'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_api_ssl_compression     = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_ca_certificates_file    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_catalog_info            = image:glance:publicURL {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_certfile                = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_keyfile                 = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_num_retries             = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance_request_timeout         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] goodness_function              = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] graceful_shutdown_timeout      = 5 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] group_api_class                = cinder.group.api.API {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] host                           = devstack {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_compress_on_upload       = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_conversion_address_space_limit = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_conversion_cpu_limit     = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_conversion_disable       = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_upload_use_cinder_backend = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_upload_use_internal_tenant = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_volume_cache_enabled     = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_volume_cache_max_count   = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] image_volume_cache_max_size_gb = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] init_host_max_objects_retrieval = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] instance_format                = [instance: %(uuid)s]  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] iscsi_target_flags             =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] iscsi_write_cache              = on {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] iser_helper                    = tgtadm {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] iser_ip_address                = 192.168.122.53 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] iser_port                      = 3260 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_color                      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_config_append              = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_dir                        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_file                       = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_options                    = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_rotate_interval            = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_rotate_interval_type       = days {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] log_rotation_type              = none {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] max_age                        = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] max_logfile_count              = 30 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] max_logfile_size_mb            = 200 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] max_over_subscription_ratio    = 20.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] message_reap_interval          = 86400 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] message_ttl                    = 2592000 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] migration_create_volume_timeout_secs = 300 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] monkey_patch                   = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] monkey_patch_modules           = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] my_ip                          = 192.168.122.53 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] no_snapshot_gb_quota           = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] num_iser_scan_tries            = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] num_shell_tries                = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] num_volume_device_scan_tries   = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] nvmeof_conn_info_version       = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] nvmet_ns_id                    = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] nvmet_port_id                  = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] osapi_max_limit                = 1000 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] osapi_volume_ext_list          = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] osapi_volume_listen_port       = 8776 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] osapi_volume_use_ssl           = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] osapi_volume_workers           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] per_volume_size_limit          = -1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] periodic_fuzzy_delay           = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] periodic_interval              = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] public_endpoint                = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] publish_errors                 = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] quota_backup_gigabytes         = 1000 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] quota_backups                  = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] quota_gigabytes                = 1000 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] quota_groups                   = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] quota_snapshots                = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] quota_volumes                  = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] rate_limit_burst               = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] rate_limit_except_level        = CRITICAL {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] rate_limit_interval            = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] reinit_driver_count            = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] replication_device             = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] report_discard_supported       = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] report_interval                = 120 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] reservation_clean_interval     = 86400 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] reservation_expire             = 86400 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] reserved_image_namespaces      = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] reserved_percentage            = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] rpc_response_timeout           = 120 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] run_external_periodic_tasks    = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] scst_target_driver             = iscsi {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] scst_target_iqn_name           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_down_time              = 720 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] shell_completion               = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87505) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] snapshot_name_template         = snapshot-%s {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] split_loggers                  = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] state_path                     = /opt/stack/data/cinder {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] storage_availability_zone      = nova {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] storage_protocol               = iSCSI {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] syslog_log_facility            = LOG_USER {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] target_helper                  = lioadm {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] target_ip_address              = 192.168.122.53 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] target_port                    = 3260 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] target_protocol                = iscsi {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] target_secondary_ip_addresses  = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] trace_flags                    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] transport_url                  = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] until_refresh                  = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] use_chap_auth                  = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] use_default_quota_class        = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] use_journal                    = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] use_json                       = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] use_multipath_for_image_xfer   = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] use_stderr                     = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] use_syslog                     = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] verify_glance_signatures       = enabled {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_api_class               = cinder.volume.api.API {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_backend_name            = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_clear                   = zero {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_clear_ionice            = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_clear_size              = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_copy_bps_limit          = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_dd_blocksize            = 1M {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_name_template           = volume-%s {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_service_inithost_offload = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volume_usage_audit_period      = month {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] zoning_mode                    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_concurrency.disable_process_locking = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.auth_section = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.auth_type   = password {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.auth_version = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.cache       = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.certfile    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.delay_auth_decision = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.http_connect_timeout = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.include_service_catalog = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.insecure    = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.interface   = public {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.keyfile     = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_password = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcache_username = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.region_name = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.service_token_roles_required = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.service_type = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.token_cache_time = 300 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.53/identity {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.backend                  = dogpile.cache.null {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.backend_argument         = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.backend_expiration_time  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.config_prefix            = cache.oslo {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.debug_cache_backend      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.enable_retry_client      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.enable_socket_keepalive  = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.enabled                  = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.expiration_time          = 600 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.hashclient_retry_attempts = 2 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.memcache_dead_retry      = 300 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.memcache_pool_maxsize    = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.memcache_sasl_enabled    = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.password                 = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.proxies                  = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.redis_db                 = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.redis_sentinel_service_name = mymaster {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.redis_server             = localhost:6379 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.retry_attempts           = 2 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.retry_delay              = 0.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.socket_keepalive_count   = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.socket_keepalive_idle    = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.socket_keepalive_interval = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.socket_timeout           = 1.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.tls_allowed_ciphers      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.tls_cafile               = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.tls_certfile             = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.tls_enabled              = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.tls_keyfile              = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cache.username                 = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] coordination.backend_url       = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.asyncio_connection    = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.asyncio_slave_connection = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.backend               = sqlalchemy {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.connection            = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.connection_debug      = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.connection_parameters =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.connection_recycle_time = 3600 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.connection_trace      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.db_inc_retry_interval = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.db_max_retries        = 20 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.db_max_retry_interval = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.db_retry_interval     = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.max_overflow          = 50 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.max_pool_size         = 5 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.max_retries           = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.mysql_wsrep_sync_wait = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.pool_timeout          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.retry_interval        = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.slave_connection      = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.sqlite_synchronous    = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.synchronous_reader    = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] database.use_db_reconnect      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_tracing.insecure = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.connection_string     = messaging:// {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.enabled               = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.es_doc_type           = notification {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.es_scroll_size        = 10000 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.es_scroll_time        = 2m {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.filter_error_trace    = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.hmac_keys             = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.sentinel_service_name = mymaster {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.socket_timeout        = 0.1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.trace_requests        = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler.trace_sqlalchemy      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler_jaeger.process_tags   = {} {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler_jaeger.service_name_prefix = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] profiler_otlp.service_name_prefix = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.enforce_new_defaults = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.policy_default_rule = default {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.policy_file        = policy.yaml {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87505) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] privsep_osbrick.group          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] privsep_osbrick.helper_command = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] privsep_osbrick.user           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_sys_admin.group         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_sys_admin.helper_command = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Running cmd (subprocess): mount.quobyte {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] cinder_sys_admin.user          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.auth_section      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.auth_type         = password {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.cafile            = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.certfile          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.collect_timing    = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.insecure          = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.keyfile           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.send_service_user_token = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.split_loggers     = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.timeout           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.tls_ciphers       = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] service_user.tls_min_version   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.auth_section            = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.auth_type               = password {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.certfile                = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.collect_timing          = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.insecure                = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.keyfile                 = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.region_name             = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.split_loggers           = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.timeout                 = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.tls_ciphers             = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] glance.tls_min_version         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.backend_availability_zone = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.chap_password = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.chap_username =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.disk_geometry = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.driver_client_cert = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.driver_client_cert_key = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.driver_data_namespace = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.driver_use_ssl = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.enable_unsupported_driver = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.extra_capabilities = {} {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.filter_function = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.goodness_function = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.iscsi_target_flags =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.iscsi_write_cache = on {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.iser_helper   = tgtadm {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.iser_ip_address = 192.168.122.53 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.iser_port     = 3260 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_host      =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_login     = admin {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_mount_options = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_password  = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_private_key =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_share_path =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.num_shell_tries = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.nvmet_port_id = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.quobyte_client_cfg = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.quobyte_volume_url = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.replication_device = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.report_discard_supported = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.reserved_percentage = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.scst_target_driver = iscsi {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.scst_target_iqn_name = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.storage_protocol = iSCSI {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.target_helper = tgtadm {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.target_ip_address = 192.168.122.53 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.target_port   = 3260 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.target_protocol = iscsi {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.trace_flags   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.unique_fqdn_network = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.use_chap_auth = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_backend_name = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_clear  = zero {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_clear_ionice = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_clear_size = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack quobyte-client[87506]: Reading configuration file: /etc/quobyte/client.cfg
Sep 08 16:30:30 devstack quobyte-client[87506]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_reports.file_event_handler = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_reports.log_dir           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.backend_availability_zone = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.backend_host         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.chap_password        = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.chap_username        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.chiscsi_conf         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.disk_geometry        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.driver_client_cert   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.driver_client_cert_key = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.driver_data_namespace = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.driver_use_ssl       = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.extra_capabilities   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.filter_function      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.goodness_function    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.iser_helper          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.iser_ip_address      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.iser_port            = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.iser_target_prefix   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_host             = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_login            = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_mount_options    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_password         = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_private_key      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_share_path       = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_ssh_port         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.num_shell_tries      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.nvmet_port_id        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.replication_device   = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.report_discard_supported = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.reserved_percentage  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.scst_target_driver   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.storage_protocol     = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.target_helper        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.target_ip_address    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.target_port          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.target_prefix        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.target_protocol      = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.trace_flags          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.use_chap_auth        = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_clear         = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_clear_size    = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] QuobyteHD.volumes_dir          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack sudo[87515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.ssl      = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_notifications.driver = [] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_notifications.retry = -1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] oslo_messaging_notifications.transport_url = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] key_manager.fixed_key          = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.barbican_api_version  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.barbican_endpoint     = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.barbican_endpoint_type = public {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.barbican_region_name  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.cafile                = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.certfile              = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.collect_timing        = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.insecure              = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.keyfile               = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.number_of_retries     = 60 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.retry_delay           = 1 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.send_service_user_token = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.split_loggers         = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.timeout               = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.tls_ciphers           = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.tls_min_version       = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.verify_ssl            = True {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican.verify_ssl_path       = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.auth_section = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.auth_type = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.cafile   = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.certfile = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.collect_timing = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.insecure = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.keyfile  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.split_loggers = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.timeout  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.tls_ciphers = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] barbican_service_user.tls_min_version = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.approle_role_id          = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.approle_secret_id        = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.auth_method              = approle {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.auth_path                = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.kv_mountpoint            = secret {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.kv_path                  = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.kv_version               = 2 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.namespace                = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.root_token_id            = **** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.ssl_ca_crt_file          = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.timeout                  = 60.0 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.token_file               = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.token_role               = None {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.use_ssl                  = False {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 08 16:30:30 devstack cinder-volume[87210]: DEBUG oslo_service.backend._eventlet.service [None req-3234205a-6e0e-40f6-a417-9678b3d3cdcd None None] ******************************************************************************** {{(pid=87210) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 08 16:30:30 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.244s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:30 devstack cinder-volume[87505]: INFO cinder.volume.driver [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Driver hasn't implemented _init_vendor_properties()
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.volume.driver [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5176582336426, 'free_capacity_gb': 1773.5176582336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87505) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_db.sqlalchemy.engines [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87505) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writer thread running {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.db.api [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Building query based on filter {{(pid=87505) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87505) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:30:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:30 devstack cinder-volume[87505]: INFO cinder.keymgr.migration [None req-9b5f4226-0b87-4d75-8f49-75d1d771ce63 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 08 16:30:30 devstack sudo[87520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:30:30 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:31 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.228s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:30:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Driver initialization completed successfully.
Sep 08 16:30:31 devstack cinder-volume[87505]: INFO cinder.manager [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Initiating service 3 cleanup
Sep 08 16:30:31 devstack cinder-volume[87505]: INFO cinder.manager [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Service 3 cleanup completed.
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG cinder.service [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Creating RPC server for service cinder-volume {{(pid=87505) start /opt/stack/cinder/cinder/service.py:231}}
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG cinder.service [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87505) start /opt/stack/cinder/cinder/service.py:237}}
Sep 08 16:30:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:30:31 devstack sudo[87531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:30:31 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:30:31 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root
Sep 08 16:30:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:30:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a5affecd-ac49-41e8-874f-494e8e539b6e None None] Driver post RPC initialization completed successfully.
Sep 08 16:30:40 devstack cinder-volume[87210]: DEBUG dbcounter [-] [87210] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87210) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:30:41 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=2 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:30:41 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:30:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:30:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 6 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:30:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Flow 'volume_create_manager' (ae07de2a-3b55-49ef-b6a5-9b2e78a153e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e009cc3f-0804-43a8-bfa9-a33785cf21b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e009cc3f-0804-43a8-bfa9-a33785cf21b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-402894182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54098bdafc449408232c649688820ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:31:29Z,use_quota=True,user_id='1b31b5e25d7f4cc8bb0f5019f290a58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32311129-836b-4f70-aade-c8985e962d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32311129-836b-4f70-aade-c8985e962d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f51d773-64d4-4981-8c95-813a8952ea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f51d773-64d4-4981-8c95-813a8952ea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3', 'volume_name': 'volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3c7b9-1941-4275-a2f6-85504bc9957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d3c7b9-1941-4275-a2f6-85504bc9957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ca37e2-2c3d-4551-8ac1-1899bd3f1c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:29 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Volume 1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3', 'volume_size': 1}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-402894182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54098bdafc449408232c649688820ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:31:29Z,use_quota=True,user_id='1b31b5e25d7f4cc8bb0f5019f290a58a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Creating volume 1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:31:29 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:31:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:31:29 devstack sudo[87842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 1073741824
Sep 08 16:31:29 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:31:30 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 1073741824" returned: 0 in 0.808s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:31:30 devstack sudo[88167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3
Sep 08 16:31:30 devstack sudo[88167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:31:30 devstack sudo[88167]: pam_unix(sudo:session): session closed for user root
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3" returned: 0 in 0.337s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ca37e2-2c3d-4551-8ac1-1899bd3f1c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219d967-abec-49b0-aae3-f764c011740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:30 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Volume volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 (1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3): created successfully
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1219d967-abec-49b0-aae3-f764c011740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Flow 'volume_create_manager' (ae07de2a-3b55-49ef-b6a5-9b2e78a153e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:31:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a7b6a1e3-199b-422c-920d-319f4355c4c7 tempest-TaggedAttachmentsTest-1285042516 None] Created volume successfully.
Sep 08 16:31:40 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:31:40 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:31:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:31:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:31:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:31:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:31:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:31:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:31:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:31:56 devstack sudo[88630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:31:56 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:31:57 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root
Sep 08 16:31:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.703s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:31:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:31:57 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:31:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 6 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:31:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Flow 'volume_create_manager' (86330f2a-e903-4f86-846c-9628509a7c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72bb757-c0f6-448e-a221-e27437a42dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72bb757-c0f6-448e-a221-e27437a42dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-746013951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa81930-9d05-4398-8240-410acbb43ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a5d4abfa14d5e8030b963516d9daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:31:58Z,use_quota=True,user_id='09e6f2e76bc94c9b92c12b12fb5cd872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae2d9be-80b0-47d6-bbe0-1d3195f67c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae2d9be-80b0-47d6-bbe0-1d3195f67c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9b1e1-811a-49b3-98c9-77a314769f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a9b1e1-811a-49b3-98c9-77a314769f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa81930-9d05-4398-8240-410acbb43ef1', 'volume_name': 'volume-1fa81930-9d05-4398-8240-410acbb43ef1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bec4afb-016a-4b15-8374-f6ad0f1aebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bec4afb-016a-4b15-8374-f6ad0f1aebf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087d119d-be2b-4239-9501-8c626767d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:31:58 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Volume 1fa81930-9d05-4398-8240-410acbb43ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa81930-9d05-4398-8240-410acbb43ef1', 'volume_size': 1}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-746013951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa81930-9d05-4398-8240-410acbb43ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a5d4abfa14d5e8030b963516d9daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:31:58Z,use_quota=True,user_id='09e6f2e76bc94c9b92c12b12fb5cd872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Creating volume 1fa81930-9d05-4398-8240-410acbb43ef1 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:31:58 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:31:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:31:58 devstack sudo[88637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1 1073741824
Sep 08 16:31:58 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:31:59 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root
Sep 08 16:31:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1 1073741824" returned: 0 in 1.033s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:31:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:31:59 devstack sudo[88644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1
Sep 08 16:31:59 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:00 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1" returned: 0 in 0.446s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:32:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087d119d-be2b-4239-9501-8c626767d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa81930-9d05-4398-8240-410acbb43ef1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7d57e4-35c9-4b80-a1ca-fcd308a05660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:00 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Volume volume-1fa81930-9d05-4398-8240-410acbb43ef1 (1fa81930-9d05-4398-8240-410acbb43ef1): created successfully
Sep 08 16:32:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7d57e4-35c9-4b80-a1ca-fcd308a05660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Flow 'volume_create_manager' (86330f2a-e903-4f86-846c-9628509a7c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:32:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-68897914-2515-4cd5-af62-70cb658af128 tempest-VolumesAdminNegativeTest-288255613 None] Created volume successfully.
Sep 08 16:32:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Acquiring lock "cinder-1fa81930-9d05-4398-8240-410acbb43ef1-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:32:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Lock "cinder-1fa81930-9d05-4398-8240-410acbb43ef1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:32:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Acquiring lock "cinder-quobyte-1fa81930-9d05-4398-8240-410acbb43ef1" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:32:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Lock "cinder-quobyte-1fa81930-9d05-4398-8240-410acbb43ef1" acquired by "delete_volume" :: waited 0.043s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:32:02 devstack cinder-volume[87505]: INFO oslo.privsep.daemon [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpb6v_bhjv/privsep.sock']
Sep 08 16:32:02 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpb6v_bhjv/privsep.sock
Sep 08 16:32:02 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 08 16:32:04 devstack cinder-volume[87505]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 08 16:32:04 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:04 devstack cinder-volume[87505]: INFO oslo.privsep.daemon [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Spawned new privsep daemon via rootwrap
Sep 08 16:32:04 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Accepted privsep connection to /tmp/tmpb6v_bhjv/privsep.sock {{(pid=87505) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 08 16:32:04 devstack cinder-volume[87505]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 08 16:32:04 devstack cinder-volume[87505]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 08 16:32:04 devstack cinder-volume[87505]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 08 16:32:04 devstack cinder-volume[87505]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88671
Sep 08 16:32:04 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8249d5-1e4a-4d70-a9e8-3b17fe7d91e6]: (2,) {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:32:04 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa694fc3-3517-47b0-8509-e98e4b787366]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:32:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:04 devstack sudo[88674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1
Sep 08 16:32:04 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1" returned: 0 in 0.494s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:05 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:05 devstack sudo[88680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1
Sep 08 16:32:05 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:05 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1fa81930-9d05-4398-8240-410acbb43ef1" returned: 0 in 0.309s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Lock "cinder-quobyte-1fa81930-9d05-4398-8240-410acbb43ef1" released by "delete_volume" :: held 3.288s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:32:05 devstack cinder-volume[87505]: WARNING cinder.quota [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:32:05 devstack cinder-volume[87505]: WARNING cinder.quota [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Created reservations ['ee2094ff-a13b-4a6d-986e-7eb38cdf78ca', '259000b5-5a27-4fd1-b66a-ccbae62bb047', 'bec10814-020c-484a-990f-3e92523fbda9', '9eb00818-85ca-40d8-9d89-6b04ca54513c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:05 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:32:05 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:06 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.331s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:06 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:32:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Deleted volume successfully.
Sep 08 16:32:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-67ece2e0-cd94-427e-8ddb-95334a9abc42 tempest-VolumesAdminNegativeTest-288255613 None] Lock "cinder-1fa81930-9d05-4398-8240-410acbb43ef1-delete_volume" released by "delete_volume" :: held 4.083s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:32:15 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=11,cinder:SELECT=8,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:32:16 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Flow 'volume_create_manager' (48069906-45c8-4dc1-ba69-7a4dbc2e0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e08cc0-dafc-454b-a047-c0713f03b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e08cc0-dafc-454b-a047-c0713f03b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1473302657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f36c26a-b70e-4032-abfa-f0edb0fba1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b0d684dfc743a8ab420186ce252227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:32:20Z,use_quota=True,user_id='899366fcb72e4207a84b297afd12c06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee3347-b1b3-4211-8be2-74515d6b0d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee3347-b1b3-4211-8be2-74515d6b0d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb1ed0f-08f8-417e-9fac-015f5dd5a543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb1ed0f-08f8-417e-9fac-015f5dd5a543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f36c26a-b70e-4032-abfa-f0edb0fba1b9', 'volume_name': 'volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df238b-09ff-46d9-bcd5-583bcceeb7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df238b-09ff-46d9-bcd5-583bcceeb7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fda6d96-e651-4299-8db9-6a36351b7134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Volume 2f36c26a-b70e-4032-abfa-f0edb0fba1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9', 'volume_size': 1}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1473302657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f36c26a-b70e-4032-abfa-f0edb0fba1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b0d684dfc743a8ab420186ce252227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:32:20Z,use_quota=True,user_id='899366fcb72e4207a84b297afd12c06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Creating volume 2f36c26a-b70e-4032-abfa-f0edb0fba1b9 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:32:20 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:32:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:20 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9 1073741824
Sep 08 16:32:20 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:21 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9 1073741824" returned: 0 in 0.546s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:21 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9
Sep 08 16:32:21 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:21 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9" returned: 0 in 0.258s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fda6d96-e651-4299-8db9-6a36351b7134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ccbb30-9301-48d8-8a40-fca2e684fa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Volume volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9 (2f36c26a-b70e-4032-abfa-f0edb0fba1b9): created successfully
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ccbb30-9301-48d8-8a40-fca2e684fa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Flow 'volume_create_manager' (48069906-45c8-4dc1-ba69-7a4dbc2e0893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:32:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6cdba68c-e5b3-4f55-853c-e73f86b9a7ab tempest-ServerActionsTestOtherA-392376613 None] Created volume successfully.
Sep 08 16:32:31 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:32:31 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Flow 'volume_create_manager' (40f2e79d-af91-4977-bc5d-3e8cef2aa3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c046d96-0f1d-495d-a68b-5a76dea2c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c046d96-0f1d-495d-a68b-5a76dea2c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1269937585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9972de-dfdb-430a-97eb-c5859c90de1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e169135c5d8e4b6280a8fcce4910b909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:32:34Z,use_quota=True,user_id='8c37473e6dc1433693f553c8375a8296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5affec1-bb2e-47c2-9320-22c568187ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5affec1-bb2e-47c2-9320-22c568187ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49004280-3895-458c-b71b-080b16f45f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49004280-3895-458c-b71b-080b16f45f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f9972de-dfdb-430a-97eb-c5859c90de1b', 'volume_name': 'volume-7f9972de-dfdb-430a-97eb-c5859c90de1b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf19226-cb93-49d0-b19a-d256c3ce3c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf19226-cb93-49d0-b19a-d256c3ce3c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b51f9d-e10a-4071-9541-200146a6d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Volume 7f9972de-dfdb-430a-97eb-c5859c90de1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f9972de-dfdb-430a-97eb-c5859c90de1b', 'volume_size': 1}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1269937585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f9972de-dfdb-430a-97eb-c5859c90de1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e169135c5d8e4b6280a8fcce4910b909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:32:34Z,use_quota=True,user_id='8c37473e6dc1433693f553c8375a8296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Creating volume 7f9972de-dfdb-430a-97eb-c5859c90de1b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:32:34 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:32:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:34 devstack sudo[88943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b 1073741824
Sep 08 16:32:34 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:35 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b 1073741824" returned: 0 in 0.939s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:35 devstack sudo[88948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b
Sep 08 16:32:35 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:35 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b" returned: 0 in 0.487s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b51f9d-e10a-4071-9541-200146a6d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f9972de-dfdb-430a-97eb-c5859c90de1b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345dc93f-4047-49b7-a9c2-14957c2f7936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:32:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Volume volume-7f9972de-dfdb-430a-97eb-c5859c90de1b (7f9972de-dfdb-430a-97eb-c5859c90de1b): created successfully
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345dc93f-4047-49b7-a9c2-14957c2f7936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:32:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Flow 'volume_create_manager' (40f2e79d-af91-4977-bc5d-3e8cef2aa3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:32:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e761b8c8-cd72-4fff-ad4e-38651b73e652 tempest-DeleteServersTestJSON-281677887 None] Created volume successfully.
Sep 08 16:32:41 devstack cinder-volume[87505]: WARNING py.warnings [req-71ef37ac-4dfb-4ab1-9f42-4ba449a8742e req-88f39edc-fc2c-484a-9ae8-fda500c8c5ac tempest-DeleteServersTestJSON-281677887 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 08 16:32:41 devstack cinder-volume[87505]:   .first()
Sep 08 16:32:41 devstack cinder-volume[87505]: 
Sep 08 16:32:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-71ef37ac-4dfb-4ab1-9f42-4ba449a8742e req-88f39edc-fc2c-484a-9ae8-fda500c8c5ac tempest-DeleteServersTestJSON-281677887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-71ef37ac-4dfb-4ab1-9f42-4ba449a8742e req-88f39edc-fc2c-484a-9ae8-fda500c8c5ac tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-71ef37ac-4dfb-4ab1-9f42-4ba449a8742e req-88f39edc-fc2c-484a-9ae8-fda500c8c5ac tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-71ef37ac-4dfb-4ab1-9f42-4ba449a8742e req-88f39edc-fc2c-484a-9ae8-fda500c8c5ac tempest-DeleteServersTestJSON-281677887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-7f9972de-dfdb-430a-97eb-c5859c90de1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2807ed6c-68e3-4510-9fd0-40f0a21aacf4', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:32:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-71ef37ac-4dfb-4ab1-9f42-4ba449a8742e req-88f39edc-fc2c-484a-9ae8-fda500c8c5ac tempest-DeleteServersTestJSON-281677887 None] attachment_update completed successfully.
Sep 08 16:32:47 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-b620f60c-29d1-439f-8462-0ad4b9c40686 req-9b946350-7bbc-40a0-aa7e-41df0e51db18 tempest-DeleteServersTestJSON-281677887 None] Terminate volume connection completed successfully.
Sep 08 16:32:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-b620f60c-29d1-439f-8462-0ad4b9c40686 req-9b946350-7bbc-40a0-aa7e-41df0e51db18 tempest-DeleteServersTestJSON-281677887 None] Deleting attachment 2807ed6c-68e3-4510-9fd0-40f0a21aacf4. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-94bcce7a-aa75-44e6-8d11-23467a3cd87b req-6fa6517c-c0c7-487a-b062-32339066e0be tempest-TaggedAttachmentsTest-1285042516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-94bcce7a-aa75-44e6-8d11-23467a3cd87b req-6fa6517c-c0c7-487a-b062-32339066e0be tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-94bcce7a-aa75-44e6-8d11-23467a3cd87b req-6fa6517c-c0c7-487a-b062-32339066e0be tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-94bcce7a-aa75-44e6-8d11-23467a3cd87b req-6fa6517c-c0c7-487a-b062-32339066e0be tempest-TaggedAttachmentsTest-1285042516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '360c9162-df64-46a4-89da-03bd796ec382', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:32:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-94bcce7a-aa75-44e6-8d11-23467a3cd87b req-6fa6517c-c0c7-487a-b062-32339066e0be tempest-TaggedAttachmentsTest-1285042516 None] attachment_update completed successfully.
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Acquiring lock "cinder-7f9972de-dfdb-430a-97eb-c5859c90de1b-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Lock "cinder-7f9972de-dfdb-430a-97eb-c5859c90de1b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Acquiring lock "cinder-quobyte-7f9972de-dfdb-430a-97eb-c5859c90de1b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Lock "cinder-quobyte-7f9972de-dfdb-430a-97eb-c5859c90de1b" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[71242f28-49fc-49d4-a1b9-d25dbeba308a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:32:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:50 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b
Sep 08 16:32:50 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:51 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b" returned: 0 in 0.499s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:51 devstack sudo[89926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b
Sep 08 16:32:51 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:51 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f9972de-dfdb-430a-97eb-c5859c90de1b" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Lock "cinder-quobyte-7f9972de-dfdb-430a-97eb-c5859c90de1b" released by "delete_volume" :: held 0.798s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Created reservations ['dab59b84-4c0b-4a9b-b567-d9a36eee0876', 'd4cc06b6-79df-4c3e-94ac-53faa5837267', 'bc682ffc-51d1-4284-8b5a-ccfa28f287fe', '240312c3-4e95-49a2-967c-52ac4aa9a518'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:51 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:32:51 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:51 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:32:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Deleted volume successfully.
Sep 08 16:32:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ca9968c7-0501-42d3-bc82-4f54354a043e tempest-DeleteServersTestJSON-281677887 None] Lock "cinder-7f9972de-dfdb-430a-97eb-c5859c90de1b-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:32:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-7cdb9c2e-7166-4da7-a754-7ff29763e836 req-a74c8502-1b12-4e67-851e-5cbf94915f9e tempest-TaggedAttachmentsTest-1285042516 None] Terminate volume connection completed successfully.
Sep 08 16:32:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-7cdb9c2e-7166-4da7-a754-7ff29763e836 req-a74c8502-1b12-4e67-851e-5cbf94915f9e tempest-TaggedAttachmentsTest-1285042516 None] Deleting attachment 360c9162-df64-46a4-89da-03bd796ec382. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:32:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:32:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:32:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:32:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:32:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:32:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:32:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:32:56 devstack sudo[90005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:32:56 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:32:57 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root
Sep 08 16:32:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.447s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:32:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:32:57 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:32:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 8 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:32:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:33:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-81f94812-35a3-44ee-87fc-12583d6c464f req-6f108ea5-dfe7-4ed9-bcb3-fdc6d4521657 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-81f94812-35a3-44ee-87fc-12583d6c464f req-6f108ea5-dfe7-4ed9-bcb3-fdc6d4521657 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-81f94812-35a3-44ee-87fc-12583d6c464f req-6f108ea5-dfe7-4ed9-bcb3-fdc6d4521657 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-81f94812-35a3-44ee-87fc-12583d6c464f req-6f108ea5-dfe7-4ed9-bcb3-fdc6d4521657 tempest-ServerActionsTestOtherA-392376613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbd1bf97-b242-482b-bf1e-c5f1e7eb89bb', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:33:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-81f94812-35a3-44ee-87fc-12583d6c464f req-6f108ea5-dfe7-4ed9-bcb3-fdc6d4521657 tempest-ServerActionsTestOtherA-392376613 None] attachment_update completed successfully.
Sep 08 16:33:08 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-0ca33069-8027-4495-a60b-c67334f80346 req-6f8db233-0b69-4e38-87f0-d72d540442a0 tempest-ServerActionsTestOtherA-392376613 None] Terminate volume connection completed successfully.
Sep 08 16:33:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-0ca33069-8027-4495-a60b-c67334f80346 req-6f8db233-0b69-4e38-87f0-d72d540442a0 tempest-ServerActionsTestOtherA-392376613 None] Deleting attachment fbd1bf97-b242-482b-bf1e-c5f1e7eb89bb. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:33:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0ca33069-8027-4495-a60b-c67334f80346 req-e82c9894-b4e3-4600-8380-511e6ebd1802 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0ca33069-8027-4495-a60b-c67334f80346 req-e82c9894-b4e3-4600-8380-511e6ebd1802 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0ca33069-8027-4495-a60b-c67334f80346 req-e82c9894-b4e3-4600-8380-511e6ebd1802 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-0ca33069-8027-4495-a60b-c67334f80346 req-e82c9894-b4e3-4600-8380-511e6ebd1802 tempest-ServerActionsTestOtherA-392376613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e695f0a6-bc19-4926-9242-90dcba6ef615', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:33:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-0ca33069-8027-4495-a60b-c67334f80346 req-e82c9894-b4e3-4600-8380-511e6ebd1802 tempest-ServerActionsTestOtherA-392376613 None] attachment_update completed successfully.
Sep 08 16:33:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Acquiring lock "cinder-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:33:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Lock "cinder-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:33:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Acquiring lock "cinder-quobyte-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:33:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Lock "cinder-quobyte-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:33:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d4c85-b3ac-40d1-a5ae-d81a30727eb3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:33:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:12 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3
Sep 08 16:33:12 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:13 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3" returned: 0 in 0.965s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:13 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3
Sep 08 16:33:13 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:13 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3" returned: 0 in 0.412s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Lock "cinder-quobyte-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3" released by "delete_volume" :: held 1.465s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:33:13 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Created reservations ['c68c076d-1470-492d-b393-6a91a71c4a54', 'ef7dcdda-58e9-4b82-88da-41fdd2ac3240', '39d8a79b-2c2c-43fc-93d2-845d6500b505', 'bd75a164-ca90-489c-b891-658f79af2e5d'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:14 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:33:14 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:14 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.536s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:33:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Deleted volume successfully.
Sep 08 16:33:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dce44865-e1c3-4e7e-a016-8885a5a3c261 tempest-TaggedAttachmentsTest-1285042516 None] Lock "cinder-1d622275-7f8a-4a0b-93f5-ac5e1e4d4af3-delete_volume" released by "delete_volume" :: held 2.408s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:33:24 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=40,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:33:24 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=27,cinder:SELECT=43,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Flow 'volume_create_manager' (8cc297eb-c49b-437e-a0bb-f26ea64c5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b130a16c-d237-4652-a8e7-348535739927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b130a16c-d237-4652-a8e7-348535739927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-50260426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab0975b-756c-454d-b7b4-8fba86e8e058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0195d60a0a5e4d4b82b71760aa465c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:33Z,use_quota=True,user_id='8067688ba28947e482ed14c86b177633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec1b521-7f0e-41a2-a747-7d25545a8959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec1b521-7f0e-41a2-a747-7d25545a8959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4688166e-02d9-4f06-9532-444aaeb23693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4688166e-02d9-4f06-9532-444aaeb23693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eab0975b-756c-454d-b7b4-8fba86e8e058', 'volume_name': 'volume-eab0975b-756c-454d-b7b4-8fba86e8e058', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49d330-9923-419e-9f3f-5eae40fe27a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e49d330-9923-419e-9f3f-5eae40fe27a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83236303-f932-4164-b3c1-4f107a6e80d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:33 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Volume eab0975b-756c-454d-b7b4-8fba86e8e058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eab0975b-756c-454d-b7b4-8fba86e8e058', 'volume_size': 1}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-50260426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eab0975b-756c-454d-b7b4-8fba86e8e058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0195d60a0a5e4d4b82b71760aa465c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:33Z,use_quota=True,user_id='8067688ba28947e482ed14c86b177633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Creating volume eab0975b-756c-454d-b7b4-8fba86e8e058 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:33:33 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:33:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:33 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058 1073741824
Sep 08 16:33:33 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:34 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058 1073741824" returned: 0 in 0.855s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:34 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058
Sep 08 16:33:34 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:35 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058" returned: 0 in 0.403s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:33:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83236303-f932-4164-b3c1-4f107a6e80d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eab0975b-756c-454d-b7b4-8fba86e8e058', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdb50f7-3356-4481-b546-1571632f5228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Volume volume-eab0975b-756c-454d-b7b4-8fba86e8e058 (eab0975b-756c-454d-b7b4-8fba86e8e058): created successfully
Sep 08 16:33:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdb50f7-3356-4481-b546-1571632f5228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Flow 'volume_create_manager' (8cc297eb-c49b-437e-a0bb-f26ea64c5b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:33:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e9991356-fd54-4528-af99-804767f74c08 tempest-ServersNegativeTestJSON-1348799223 None] Created volume successfully.
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Flow 'volume_create_manager' (2814965d-3f08-4cc2-b606-a0503c9c1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1bb948-e571-499c-a4fc-bdcbb0e033bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1bb948-e571-499c-a4fc-bdcbb0e033bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-180149881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5472f286-94ba-4ca5-9588-f41d93085147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0195d60a0a5e4d4b82b71760aa465c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:37Z,use_quota=True,user_id='8067688ba28947e482ed14c86b177633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80be0ca6-6864-4b9b-8847-96be261015a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80be0ca6-6864-4b9b-8847-96be261015a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6940c9b-d1ea-49f6-9d45-edc594d3d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6940c9b-d1ea-49f6-9d45-edc594d3d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5472f286-94ba-4ca5-9588-f41d93085147', 'volume_name': 'volume-5472f286-94ba-4ca5-9588-f41d93085147', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4d42b5-4ce0-4705-848c-09887250b5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4d42b5-4ce0-4705-848c-09887250b5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d6d816-ff72-42d1-9352-7badba218f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:37 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Volume 5472f286-94ba-4ca5-9588-f41d93085147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5472f286-94ba-4ca5-9588-f41d93085147', 'volume_size': 1}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-180149881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5472f286-94ba-4ca5-9588-f41d93085147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0195d60a0a5e4d4b82b71760aa465c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:37Z,use_quota=True,user_id='8067688ba28947e482ed14c86b177633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Creating volume 5472f286-94ba-4ca5-9588-f41d93085147 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:33:37 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:37 devstack sudo[91368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147 1073741824
Sep 08 16:33:37 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:37 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147 1073741824" returned: 0 in 0.527s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:37 devstack sudo[91374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147
Sep 08 16:33:37 devstack sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:38 devstack sudo[91374]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:33:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d6d816-ff72-42d1-9352-7badba218f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5472f286-94ba-4ca5-9588-f41d93085147', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24da8f28-671d-4f84-a3e8-7055cf64ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:38 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Volume volume-5472f286-94ba-4ca5-9588-f41d93085147 (5472f286-94ba-4ca5-9588-f41d93085147): created successfully
Sep 08 16:33:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24da8f28-671d-4f84-a3e8-7055cf64ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Flow 'volume_create_manager' (2814965d-3f08-4cc2-b606-a0503c9c1010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:33:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3a6356a1-47e6-4af0-a766-9305b726460b tempest-ServersNegativeTestJSON-1348799223 None] Created volume successfully.
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "cinder-5472f286-94ba-4ca5-9588-f41d93085147-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-5472f286-94ba-4ca5-9588-f41d93085147-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "cinder-quobyte-5472f286-94ba-4ca5-9588-f41d93085147" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-quobyte-5472f286-94ba-4ca5-9588-f41d93085147" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b525f3b0-4bcc-43d7-9236-b19a96b414a1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:40 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147
Sep 08 16:33:40 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:40 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147" returned: 0 in 0.413s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:40 devstack sudo[91387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147
Sep 08 16:33:40 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:40 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5472f286-94ba-4ca5-9588-f41d93085147" returned: 0 in 0.269s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-quobyte-5472f286-94ba-4ca5-9588-f41d93085147" released by "delete_volume" :: held 0.737s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Created reservations ['24824e45-d779-4a13-ace1-614f91a664fa', 'eb364f79-8f24-4575-9133-a75a87fdcf73', '06d2ad13-9d8e-42ac-a07c-c62194f48f60', 'fbedcbf4-26ef-43fa-a9ba-8116f6b8c1d1'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:41 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:33:41 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "cinder-eab0975b-756c-454d-b7b4-8fba86e8e058-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-eab0975b-756c-454d-b7b4-8fba86e8e058-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "cinder-quobyte-eab0975b-756c-454d-b7b4-8fba86e8e058" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-quobyte-eab0975b-756c-454d-b7b4-8fba86e8e058" acquired by "delete_volume" :: waited 0.037s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eb83cd-1cbc-4e0d-8595-3c86244b4005]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:41 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.590s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:33:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Deleted volume successfully.
Sep 08 16:33:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ee8c5400-d10e-4c36-a050-f733c65a254c tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-5472f286-94ba-4ca5-9588-f41d93085147-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:33:41 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058
Sep 08 16:33:41 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:42 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058" returned: 0 in 0.478s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:42 devstack sudo[91400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058
Sep 08 16:33:42 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:42 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-eab0975b-756c-454d-b7b4-8fba86e8e058" returned: 0 in 0.301s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-quobyte-eab0975b-756c-454d-b7b4-8fba86e8e058" released by "delete_volume" :: held 0.866s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Created reservations ['ec6688e7-fed4-480c-8ee5-9076129743e2', '4901b20e-eea3-4b1f-83ad-607f67194d69', '832bfdbc-2079-467e-984d-920eaec098da', 'e45962bd-3a35-4e6b-b1f8-126bb781deba'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:42 devstack sudo[91403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:33:42 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:42 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.365s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:42 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:33:43 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Deleted volume successfully.
Sep 08 16:33:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d5326311-98bc-4378-a55f-608af0d19372 tempest-ServersNegativeTestJSON-1348799223 None] Lock "cinder-eab0975b-756c-454d-b7b4-8fba86e8e058-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:33:43 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-a5d2a2f3-ed03-420e-84ea-b76aa9ca40a2 req-01c520a4-1801-4230-bd2e-4e06e2caf2fd tempest-ServerActionsTestOtherA-392376613 None] Terminate volume connection completed successfully.
Sep 08 16:33:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-a5d2a2f3-ed03-420e-84ea-b76aa9ca40a2 req-01c520a4-1801-4230-bd2e-4e06e2caf2fd tempest-ServerActionsTestOtherA-392376613 None] Deleting attachment e695f0a6-bc19-4926-9242-90dcba6ef615. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=17,cinder:UPDATE=21,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Flow 'volume_create_manager' (c49c8539-d951-48dd-9ffc-56ecc7a97105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10279e15-aa7c-4847-b299-4bff0b5f9369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10279e15-aa7c-4847-b299-4bff0b5f9369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-624902969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d076de-4a35-4915-b6c4-53f1568b66fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b0d684dfc743a8ab420186ce252227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:53Z,use_quota=True,user_id='899366fcb72e4207a84b297afd12c06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14ffe3f-cb03-4003-b10a-b269f9b4804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14ffe3f-cb03-4003-b10a-b269f9b4804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8db320a-40ff-4cb2-bd5a-c38e41d38ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:53 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8db320a-40ff-4cb2-bd5a-c38e41d38ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1d076de-4a35-4915-b6c4-53f1568b66fa', 'volume_name': 'volume-e1d076de-4a35-4915-b6c4-53f1568b66fa', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a344088a0f0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790e6f49-9629-4bcd-8a57-329a48e9335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790e6f49-9629-4bcd-8a57-329a48e9335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fb275c-1c4b-49d7-9654-da21b034e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:54 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Volume e1d076de-4a35-4915-b6c4-53f1568b66fa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1d076de-4a35-4915-b6c4-53f1568b66fa', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a344088a0f0>}
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Trying to clone e1d076de-4a35-4915-b6c4-53f1568b66fa from image 9bf04763-a04a-46d0-817b-b7085cff6448 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:33:54 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Image download 20.69 MB at 20.69 MB/s
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6411a8-32c2-4c28-b130-588b342cf22f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:33:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:55 devstack sudo[91570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD
Sep 08 16:33:55 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:55 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD" returned: 0 in 0.573s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:55 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 is fetched for user 899366fcb72e4207a84b297afd12c06c. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:33:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d221e824-248f-4b6c-903e-6d35519f08a6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:33:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:55 devstack sudo[91586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD
Sep 08 16:33:55 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:56 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-624902969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d076de-4a35-4915-b6c4-53f1568b66fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b0d684dfc743a8ab420186ce252227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:53Z,use_quota=True,user_id='899366fcb72e4207a84b297afd12c06c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Creating volume e1d076de-4a35-4915-b6c4-53f1568b66fa {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:33:56 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:56 devstack sudo[91593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa 1073741824
Sep 08 16:33:56 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:56 devstack sudo[91609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:33:56 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:57 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.508s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:33:57 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa 1073741824" returned: 0 in 1.014s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:57 devstack sudo[91619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa
Sep 08 16:33:57 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:57 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Attempting download of 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume e1d076de-4a35-4915-b6c4-53f1568b66fa. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[990fe5fc-42bf-4b48-ba12-f5b6c9bf02b6]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:33:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_zrt0v2qt {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:57 devstack sudo[91622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_zrt0v2qt
Sep 08 16:33:57 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:58 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_zrt0v2qt" returned: 0 in 0.561s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_zrt0v2qt {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:58 devstack sudo[91628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_zrt0v2qt
Sep 08 16:33:58 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:58 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_zrt0v2qt" returned: 1 in 0.455s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_zrt0v2qt' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:33:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c34e1-099b-4d8f-81a4-da69a998bbfd]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:33:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:58 devstack sudo[91638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD
Sep 08 16:33:58 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:59 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] 9bf04763-a04a-46d0-817b-b7085cff6448 was qcow2, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:59 devstack sudo[91643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa
Sep 08 16:33:59 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Flow 'volume_create_manager' (d169b5e3-1edf-4606-8916-00bc939ef253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17faa90b-6279-40d8-a8be-c0f428e3dbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17faa90b-6279-40d8-a8be-c0f428e3dbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1451595617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af5999e-a453-453d-92e1-8c6c1abdc47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5946c8a613e4e54858cabf6f2ae6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:59Z,use_quota=True,user_id='255a08978f0a42caa0e4e728dd4acd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4aadbb7-974a-4e07-96c8-8f697d7e91ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4aadbb7-974a-4e07-96c8-8f697d7e91ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b45b19-4a68-41ef-9cb1-59183c11b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b45b19-4a68-41ef-9cb1-59183c11b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af5999e-a453-453d-92e1-8c6c1abdc47f', 'volume_name': 'volume-3af5999e-a453-453d-92e1-8c6c1abdc47f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0af290-7226-4505-9b66-214bebbb0483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0af290-7226-4505-9b66-214bebbb0483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f671f989-58f1-40b2-ae5d-70ccb2279245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:33:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Volume 3af5999e-a453-453d-92e1-8c6c1abdc47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af5999e-a453-453d-92e1-8c6c1abdc47f', 'volume_size': 1}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1451595617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af5999e-a453-453d-92e1-8c6c1abdc47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5946c8a613e4e54858cabf6f2ae6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:33:59Z,use_quota=True,user_id='255a08978f0a42caa0e4e728dd4acd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Creating volume 3af5999e-a453-453d-92e1-8c6c1abdc47f {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:33:59 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:33:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:33:59 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f 1073741824
Sep 08 16:33:59 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:00 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f 1073741824" returned: 0 in 0.674s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:00 devstack sudo[91675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f
Sep 08 16:34:00 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:01 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f" returned: 0 in 0.626s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:34:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f671f989-58f1-40b2-ae5d-70ccb2279245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af5999e-a453-453d-92e1-8c6c1abdc47f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6105a63a-6a39-4949-90b4-fafebdbe5ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:01 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Volume volume-3af5999e-a453-453d-92e1-8c6c1abdc47f (3af5999e-a453-453d-92e1-8c6c1abdc47f): created successfully
Sep 08 16:34:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6105a63a-6a39-4949-90b4-fafebdbe5ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Flow 'volume_create_manager' (d169b5e3-1edf-4606-8916-00bc939ef253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-549e0ea4-285b-4f60-a390-0fad3fc1e0a6 tempest-AttachVolumeTestJSON-179529324 None] Created volume successfully.
Sep 08 16:34:02 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa" returned: 0 in 3.555s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:02 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_xcns23e2devstack@QuobyteHD, size 112.00 MB, duration 3.56 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:34:02 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Converted 112.00 MB image at 31.49 MB/s
Sep 08 16:34:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:02 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa 1G
Sep 08 16:34:02 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:03 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa 1G" returned: 0 in 1.085s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:03 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Downloaded image 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume e1d076de-4a35-4915-b6c4-53f1568b66fa successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:34:03 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 for user 899366fcb72e4207a84b297afd12c06c is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:34:03 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Marking volume e1d076de-4a35-4915-b6c4-53f1568b66fa as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:34:03 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Copying metadata from image 9bf04763-a04a-46d0-817b-b7085cff6448 to e1d076de-4a35-4915-b6c4-53f1568b66fa. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:34:03 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Creating volume glance metadata for volume e1d076de-4a35-4915-b6c4-53f1568b66fa backed by image 9bf04763-a04a-46d0-817b-b7085cff6448 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e1eeb2fc-508a-4a0c-b323-f2e032060519 req-0aa92583-c743-4fef-9b69-12043f7f0f1a tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e1eeb2fc-508a-4a0c-b323-f2e032060519 req-0aa92583-c743-4fef-9b69-12043f7f0f1a tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e1eeb2fc-508a-4a0c-b323-f2e032060519 req-0aa92583-c743-4fef-9b69-12043f7f0f1a tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fb275c-1c4b-49d7-9654-da21b034e642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d076de-4a35-4915-b6c4-53f1568b66fa', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a344088a0f0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81a5c13-8f1b-43f2-89ed-2735ff853453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:04 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Volume volume-e1d076de-4a35-4915-b6c4-53f1568b66fa (e1d076de-4a35-4915-b6c4-53f1568b66fa): created successfully
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81a5c13-8f1b-43f2-89ed-2735ff853453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Flow 'volume_create_manager' (c49c8539-d951-48dd-9ffc-56ecc7a97105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:04 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-08772847-9863-4579-982b-84b8a9587d31 tempest-ServerActionsTestOtherA-392376613 None] Created volume successfully.
Sep 08 16:34:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-e1eeb2fc-508a-4a0c-b323-f2e032060519 req-0aa92583-c743-4fef-9b69-12043f7f0f1a tempest-AttachVolumeTestJSON-179529324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-3af5999e-a453-453d-92e1-8c6c1abdc47f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b4bb308-83b6-4812-95be-be4c827c0b39', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:34:04 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-e1eeb2fc-508a-4a0c-b323-f2e032060519 req-0aa92583-c743-4fef-9b69-12043f7f0f1a tempest-AttachVolumeTestJSON-179529324 None] attachment_update completed successfully.
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Flow 'volume_create_manager' (a1613481-55f6-4c95-ab5c-a04d48dc374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ebacd0-e01a-422e-ac07-0c68dc1d2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ebacd0-e01a-422e-ac07-0c68dc1d2368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2022282573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ce70be-10b0-4988-8d1e-b50871c6bc1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7faecbf6da28484e9a619661a468467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:05Z,use_quota=True,user_id='35edd492f9714505930fa9428f43c781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e08ffbc-f6bb-40c0-94de-7a88169f86ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e08ffbc-f6bb-40c0-94de-7a88169f86ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5d0b28-bcf5-4225-8734-c79a932ce610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f5d0b28-bcf5-4225-8734-c79a932ce610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ce70be-10b0-4988-8d1e-b50871c6bc1f', 'volume_name': 'volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d47741f-50ad-4f5a-9be3-805359f20275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d47741f-50ad-4f5a-9be3-805359f20275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe26414-e5fc-47f8-a32b-f62306b6dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:05 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Volume f6ce70be-10b0-4988-8d1e-b50871c6bc1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f', 'volume_size': 1}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2022282573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ce70be-10b0-4988-8d1e-b50871c6bc1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7faecbf6da28484e9a619661a468467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:05Z,use_quota=True,user_id='35edd492f9714505930fa9428f43c781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Creating volume f6ce70be-10b0-4988-8d1e-b50871c6bc1f {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:34:05 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:34:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:05 devstack sudo[92182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f 1073741824
Sep 08 16:34:05 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:06 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f 1073741824" returned: 0 in 1.165s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:06 devstack sudo[92191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f
Sep 08 16:34:06 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:07 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f" returned: 0 in 0.789s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:34:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe26414-e5fc-47f8-a32b-f62306b6dd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090a0130-2474-4b35-9a78-3c4e337df085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Volume volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f (f6ce70be-10b0-4988-8d1e-b50871c6bc1f): created successfully
Sep 08 16:34:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090a0130-2474-4b35-9a78-3c4e337df085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Flow 'volume_create_manager' (a1613481-55f6-4c95-ab5c-a04d48dc374a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6497f429-a741-4ac8-ad2e-aa39f65cccca tempest-VolumesTestJSON-1935238418 None] Created volume successfully.
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Flow 'volume_create_manager' (76e748c1-ade7-44a7-a4b6-81a8e40ca8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bcf62b-f8dc-4ead-b5e2-f991cc1bdce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bcf62b-f8dc-4ead-b5e2-f991cc1bdce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-247938389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f4b906-ef24-4de4-8861-47c729c704f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7faecbf6da28484e9a619661a468467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:10Z,use_quota=True,user_id='35edd492f9714505930fa9428f43c781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada950eb-9e3c-4f1f-952c-91f464b84423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada950eb-9e3c-4f1f-952c-91f464b84423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28659a9d-ff66-476a-82f1-7835a1c91641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28659a9d-ff66-476a-82f1-7835a1c91641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f4b906-ef24-4de4-8861-47c729c704f8', 'volume_name': 'volume-94f4b906-ef24-4de4-8861-47c729c704f8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5c7dd1-7bf6-450b-8efb-980d68a63117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5c7dd1-7bf6-450b-8efb-980d68a63117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2756a40-ceb3-4b93-b8c2-af77ea9ac722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:09 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Volume 94f4b906-ef24-4de4-8861-47c729c704f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f4b906-ef24-4de4-8861-47c729c704f8', 'volume_size': 1}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-247938389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f4b906-ef24-4de4-8861-47c729c704f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7faecbf6da28484e9a619661a468467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:10Z,use_quota=True,user_id='35edd492f9714505930fa9428f43c781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Creating volume 94f4b906-ef24-4de4-8861-47c729c704f8 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:34:09 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:34:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:10 devstack sudo[92247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8 1073741824
Sep 08 16:34:10 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0408225c-6b27-4287-ba66-86149df6b153 req-a0b81be2-3f58-4721-8104-4a5b5f9d8be5 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:10 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8 1073741824" returned: 0 in 0.881s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:11 devstack sudo[92261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8
Sep 08 16:34:11 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:11 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8" returned: 0 in 0.502s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0408225c-6b27-4287-ba66-86149df6b153 req-a0b81be2-3f58-4721-8104-4a5b5f9d8be5 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.849s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2756a40-ceb3-4b93-b8c2-af77ea9ac722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f4b906-ef24-4de4-8861-47c729c704f8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521b2d93-1293-486a-a174-dfc897bc89ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0408225c-6b27-4287-ba66-86149df6b153 req-a0b81be2-3f58-4721-8104-4a5b5f9d8be5 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.158s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:11 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Volume volume-94f4b906-ef24-4de4-8861-47c729c704f8 (94f4b906-ef24-4de4-8861-47c729c704f8): created successfully
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521b2d93-1293-486a-a174-dfc897bc89ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Flow 'volume_create_manager' (76e748c1-ade7-44a7-a4b6-81a8e40ca8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:11 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f235ee12-e90a-442c-be07-e41d79d04f15 tempest-VolumesTestJSON-1935238418 None] Created volume successfully.
Sep 08 16:34:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-0408225c-6b27-4287-ba66-86149df6b153 req-a0b81be2-3f58-4721-8104-4a5b5f9d8be5 tempest-ServerActionsTestOtherA-392376613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-e1d076de-4a35-4915-b6c4-53f1568b66fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6ee7f40-05c3-4b96-9803-f1cf0d704956', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:34:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-0408225c-6b27-4287-ba66-86149df6b153 req-a0b81be2-3f58-4721-8104-4a5b5f9d8be5 tempest-ServerActionsTestOtherA-392376613 None] attachment_update completed successfully.
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Flow 'volume_create_manager' (3db34e9d-5b2d-4b85-8871-8ce635708ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ebfcff-a0c2-4015-aec7-92c02bf29d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ebfcff-a0c2-4015-aec7-92c02bf29d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-668269093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb941c3-7d3e-479d-b4db-e15e086f728e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7faecbf6da28484e9a619661a468467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:13Z,use_quota=True,user_id='35edd492f9714505930fa9428f43c781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2739707-3fe0-46d9-a7ec-6c9c471e22a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2739707-3fe0-46d9-a7ec-6c9c471e22a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7604e989-8d8f-49fe-8b33-6e8b87f29f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7604e989-8d8f-49fe-8b33-6e8b87f29f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feb941c3-7d3e-479d-b4db-e15e086f728e', 'volume_name': 'volume-feb941c3-7d3e-479d-b4db-e15e086f728e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058befd3-fb30-4e18-8aba-3fc18777bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058befd3-fb30-4e18-8aba-3fc18777bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544b850b-13f9-463a-a393-0f5ebc94d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:13 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Volume feb941c3-7d3e-479d-b4db-e15e086f728e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feb941c3-7d3e-479d-b4db-e15e086f728e', 'volume_size': 1}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-668269093',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feb941c3-7d3e-479d-b4db-e15e086f728e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7faecbf6da28484e9a619661a468467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:13Z,use_quota=True,user_id='35edd492f9714505930fa9428f43c781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Creating volume feb941c3-7d3e-479d-b4db-e15e086f728e {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:34:13 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:34:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:13 devstack sudo[92265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e 1073741824
Sep 08 16:34:13 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:14 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e 1073741824" returned: 0 in 1.122s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:14 devstack sudo[92314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e
Sep 08 16:34:14 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:15 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e" returned: 0 in 0.684s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:34:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (544b850b-13f9-463a-a393-0f5ebc94d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feb941c3-7d3e-479d-b4db-e15e086f728e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2313ec08-fbd5-4731-a234-09444596d7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:15 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Volume volume-feb941c3-7d3e-479d-b4db-e15e086f728e (feb941c3-7d3e-479d-b4db-e15e086f728e): created successfully
Sep 08 16:34:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2313ec08-fbd5-4731-a234-09444596d7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Flow 'volume_create_manager' (3db34e9d-5b2d-4b85-8871-8ce635708ea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-75f415a8-723e-4f2a-86a1-0053200c4209 tempest-VolumesTestJSON-1935238418 None] Created volume successfully.
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Flow 'volume_create_manager' (19c0dd2f-039b-4846-a906-c781c527f406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ff47d0-75dd-4eb2-a75a-665d9a2ad6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ff47d0-75dd-4eb2-a75a-665d9a2ad6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-672200008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4694b2c-e103-4236-a6d0-5604ab5ab813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a27bdd8534d9cab3e2f5c3ab53c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:16Z,use_quota=True,user_id='3f14b4b98f2848d280b5cdb289a7b8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8534d6-f318-40e5-8fea-63fb0fd12fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8534d6-f318-40e5-8fea-63fb0fd12fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8473864d-73f8-4b3a-ac94-6a4426759786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8473864d-73f8-4b3a-ac94-6a4426759786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4694b2c-e103-4236-a6d0-5604ab5ab813', 'volume_name': 'volume-f4694b2c-e103-4236-a6d0-5604ab5ab813', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a02eae-eba1-4292-8893-342355a6c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a02eae-eba1-4292-8893-342355a6c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cda7f35-645d-45a2-80c1-ddc7412c3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Volume f4694b2c-e103-4236-a6d0-5604ab5ab813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4694b2c-e103-4236-a6d0-5604ab5ab813', 'volume_size': 1}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-672200008',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4694b2c-e103-4236-a6d0-5604ab5ab813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949a27bdd8534d9cab3e2f5c3ab53c7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:16Z,use_quota=True,user_id='3f14b4b98f2848d280b5cdb289a7b8b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Creating volume f4694b2c-e103-4236-a6d0-5604ab5ab813 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:34:16 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:34:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:16 devstack sudo[92392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813 1073741824
Sep 08 16:34:16 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:17 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813 1073741824" returned: 0 in 1.240s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:17 devstack sudo[92766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813
Sep 08 16:34:17 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:18 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813" returned: 0 in 0.797s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:34:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cda7f35-645d-45a2-80c1-ddc7412c3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4694b2c-e103-4236-a6d0-5604ab5ab813', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98577744-3a27-450b-bc62-c8c7455125e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:18 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Volume volume-f4694b2c-e103-4236-a6d0-5604ab5ab813 (f4694b2c-e103-4236-a6d0-5604ab5ab813): created successfully
Sep 08 16:34:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98577744-3a27-450b-bc62-c8c7455125e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Flow 'volume_create_manager' (19c0dd2f-039b-4846-a906-c781c527f406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6af4527a-08a9-42a6-91cf-9b05f2dcccfc tempest-ServerRescueNegativeTestJSON-1300421643 None] Created volume successfully.
Sep 08 16:34:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "cinder-feb941c3-7d3e-479d-b4db-e15e086f728e-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-feb941c3-7d3e-479d-b4db-e15e086f728e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "cinder-quobyte-feb941c3-7d3e-479d-b4db-e15e086f728e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-quobyte-feb941c3-7d3e-479d-b4db-e15e086f728e" acquired by "delete_volume" :: waited 0.038s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:19 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a24e954-f3d7-4aed-a355-cd2aa0d060d6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:34:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:20 devstack sudo[92844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e
Sep 08 16:34:20 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:21 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e" returned: 0 in 1.321s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:21 devstack sudo[92862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e
Sep 08 16:34:21 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:22 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-feb941c3-7d3e-479d-b4db-e15e086f728e" returned: 0 in 1.167s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-quobyte-feb941c3-7d3e-479d-b4db-e15e086f728e" released by "delete_volume" :: held 2.615s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Created reservations ['4daeb016-454c-4ec7-af7d-ff24f83dbc51', '14628efe-fe95-41b5-b384-81f781812731', '6d5af2d6-d7b5-4e1a-ae7d-314986223ba7', '0b2c536d-b6c2-4f0f-879d-bc141d76b998'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:22 devstack sudo[92872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:34:22 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Acquiring lock "cinder-94f4b906-ef24-4de4-8861-47c729c704f8-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:23 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Lock "cinder-94f4b906-ef24-4de4-8861-47c729c704f8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.940s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:34:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Deleted volume successfully.
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c0a4548f-e9a9-4eda-b360-a086c0323276 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-feb941c3-7d3e-479d-b4db-e15e086f728e-delete_volume" released by "delete_volume" :: held 4.225s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Acquiring lock "cinder-quobyte-94f4b906-ef24-4de4-8861-47c729c704f8" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Lock "cinder-quobyte-94f4b906-ef24-4de4-8861-47c729c704f8" acquired by "delete_volume" :: waited 0.043s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab045fc-c4ee-4f67-8665-82bbd4b1e1dc]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:34:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:23 devstack sudo[92884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8
Sep 08 16:34:23 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:24 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8" returned: 0 in 0.808s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:24 devstack sudo[92910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8
Sep 08 16:34:24 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:25 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94f4b906-ef24-4de4-8861-47c729c704f8" returned: 0 in 0.585s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Lock "cinder-quobyte-94f4b906-ef24-4de4-8861-47c729c704f8" released by "delete_volume" :: held 1.471s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Created reservations ['c7ae1efc-a6b1-43f1-bfdb-ac1992a90dfd', '432c14ed-e048-40cb-90a3-f9554c3e0e58', 'da89c675-c806-4737-b11f-7722e7d5b5c5', '0be21317-6a01-405e-b72c-556c39c10789'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:25 devstack sudo[92917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:34:25 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:25 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:34:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Deleted volume successfully.
Sep 08 16:34:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-005c7f95-837f-46d8-a6b6-278c8defe3ea tempest-VolumesTestJSON-1935238418 None] Lock "cinder-94f4b906-ef24-4de4-8861-47c729c704f8-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "cinder-f6ce70be-10b0-4988-8d1e-b50871c6bc1f-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-f6ce70be-10b0-4988-8d1e-b50871c6bc1f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "cinder-quobyte-f6ce70be-10b0-4988-8d1e-b50871c6bc1f" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-quobyte-f6ce70be-10b0-4988-8d1e-b50871c6bc1f" acquired by "delete_volume" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:26 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b4867b-6191-47c6-8acd-38ebe50c4b44]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:34:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:26 devstack sudo[92923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f
Sep 08 16:34:26 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:27 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f" returned: 0 in 1.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:27 devstack sudo[92937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f
Sep 08 16:34:27 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:28 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f6ce70be-10b0-4988-8d1e-b50871c6bc1f" returned: 0 in 1.000s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-quobyte-f6ce70be-10b0-4988-8d1e-b50871c6bc1f" released by "delete_volume" :: held 2.434s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Created reservations ['e9e1060e-44e5-4c09-89d7-71c9c54d1ef0', '2e156c1b-d73a-4348-8fd0-725470d5964f', '18927bbe-3924-4c5b-b7ab-71511357e48c', '93a25c6e-6c6c-4dd1-90c6-5390a3bcfb53'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:29 devstack sudo[92958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:34:29 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:29 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.575s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:29 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:34:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Deleted volume successfully.
Sep 08 16:34:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-13243013-bdb2-4032-87c7-6dc76695a709 tempest-VolumesTestJSON-1935238418 None] Lock "cinder-f6ce70be-10b0-4988-8d1e-b50871c6bc1f-delete_volume" released by "delete_volume" :: held 3.675s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Acquiring lock "cinder-f4694b2c-e103-4236-a6d0-5604ab5ab813-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "cinder-f4694b2c-e103-4236-a6d0-5604ab5ab813-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Acquiring lock "cinder-quobyte-f4694b2c-e103-4236-a6d0-5604ab5ab813" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:34:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "cinder-quobyte-f4694b2c-e103-4236-a6d0-5604ab5ab813" acquired by "delete_volume" :: waited 0.049s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:34:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f89d5f-5f2c-4bb9-94a2-6803fe25d5db]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:34:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:36 devstack sudo[93072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813
Sep 08 16:34:36 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:36 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813" returned: 0 in 0.874s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:36 devstack sudo[93077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813
Sep 08 16:34:36 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:37 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f4694b2c-e103-4236-a6d0-5604ab5ab813" returned: 0 in 0.594s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "cinder-quobyte-f4694b2c-e103-4236-a6d0-5604ab5ab813" released by "delete_volume" :: held 1.570s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Created reservations ['14d5a304-942a-4c9b-bf77-a95a7771e9fb', '13d67fc8-d5ff-4fab-9501-621bd6e6b865', 'ff5ff351-f013-4f9d-8064-f5e649059c79', 'e0c36fb8-69d9-4b28-ac78-ddb31adc55c8'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:37 devstack sudo[93100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:34:37 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-0e2db4c8-bcff-439a-aad0-2c90f08eaef3 req-8e2cb0dc-3dbb-4cf2-92b7-0f741d4dc437 tempest-ServerActionsTestOtherA-392376613 None] Terminate volume connection completed successfully.
Sep 08 16:34:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-0e2db4c8-bcff-439a-aad0-2c90f08eaef3 req-8e2cb0dc-3dbb-4cf2-92b7-0f741d4dc437 tempest-ServerActionsTestOtherA-392376613 None] Deleting attachment a6ee7f40-05c3-4b96-9803-f1cf0d704956. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:34:38 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.924s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:38 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:34:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Deleted volume successfully.
Sep 08 16:34:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-807a3e26-5c87-4793-8252-743176114a2d tempest-ServerRescueNegativeTestJSON-1300421643 None] Lock "cinder-f4694b2c-e103-4236-a6d0-5604ab5ab813-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:34:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0e2db4c8-bcff-439a-aad0-2c90f08eaef3 req-37b00d7c-2fa2-47fa-9ea8-fccf5586724e tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0e2db4c8-bcff-439a-aad0-2c90f08eaef3 req-37b00d7c-2fa2-47fa-9ea8-fccf5586724e tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0e2db4c8-bcff-439a-aad0-2c90f08eaef3 req-37b00d7c-2fa2-47fa-9ea8-fccf5586724e tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:42 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-0e2db4c8-bcff-439a-aad0-2c90f08eaef3 req-37b00d7c-2fa2-47fa-9ea8-fccf5586724e tempest-ServerActionsTestOtherA-392376613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-e1d076de-4a35-4915-b6c4-53f1568b66fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '521a1065-191c-4a1e-93b2-214ff9a56195', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:34:42 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-0e2db4c8-bcff-439a-aad0-2c90f08eaef3 req-37b00d7c-2fa2-47fa-9ea8-fccf5586724e tempest-ServerActionsTestOtherA-392376613 None] attachment_update completed successfully.
Sep 08 16:34:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-516cf4ae-b2e8-49af-8540-fa476e3f227a tempest-BackendsCapabilitiesAdminTestsJSON-599591485 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5176582336426, 'free_capacity_gb': 1773.5176582336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87505) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 08 16:34:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00cfe31e-50b3-4dbe-90c3-f59125796649 tempest-BackendsCapabilitiesAdminTestsJSON-599591485 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5176582336426, 'free_capacity_gb': 1773.5176582336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87505) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 08 16:34:52 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=62,cinder:SELECT=53,cinder:DELETE=6,cinder:INSERT=17 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:34:52 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=68,cinder:INSERT=18,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:34:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0133f91a-8623-4a29-990c-fe2feecb8a86 tempest-GroupsV314Test-787887018 None] Group tempest-GroupsV314Test-Group-2128034500: creating
Sep 08 16:34:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0133f91a-8623-4a29-990c-fe2feecb8a86 tempest-GroupsV314Test-787887018 None] Group tempest-GroupsV314Test-Group-2128034500: created successfully
Sep 08 16:34:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0133f91a-8623-4a29-990c-fe2feecb8a86 tempest-GroupsV314Test-787887018 None] Create group completed successfully.
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:56 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:34:56 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:56 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.277s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:34:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Flow 'volume_create_manager' (ab9e892d-d2b9-4417-8510-e9df50696c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4549749f-9e48-43b4-8147-1a7dfd1a92e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4549749f-9e48-43b4-8147-1a7dfd1a92e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607239508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59db1eaf-4304-4bec-a08b-787af734022f,host='devstack@QuobyteHD#QuobyteHD',id=07558c82-b784-41ce-a8e8-d9930e2eb514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8ebdd69fdb46018098ab82f19d5135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:58Z,use_quota=True,user_id='41cec85601844d37921632a5e6e139a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f31ed6f5-74ae-4635-95bc-e55949a12b7a),volume_type_id=f31ed6f5-74ae-4635-95bc-e55949a12b7a)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cd5e54-42d7-499d-84fe-42221ce623b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68cd5e54-42d7-499d-84fe-42221ce623b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d40dabd-85eb-41bd-8b15-f50fbf7dc413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d40dabd-85eb-41bd-8b15-f50fbf7dc413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07558c82-b784-41ce-a8e8-d9930e2eb514', 'volume_name': 'volume-07558c82-b784-41ce-a8e8-d9930e2eb514', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d98a1e1-65b5-4a57-8d80-948f35ca712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d98a1e1-65b5-4a57-8d80-948f35ca712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf23b1d-c922-42d9-b737-9e2fc565a3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:58 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Volume 07558c82-b784-41ce-a8e8-d9930e2eb514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07558c82-b784-41ce-a8e8-d9930e2eb514', 'volume_size': 1}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=59db1eaf-4304-4bec-a08b-787af734022f,created_at=2026-09-08T14:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-607239508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=59db1eaf-4304-4bec-a08b-787af734022f,host='devstack@QuobyteHD#QuobyteHD',id=07558c82-b784-41ce-a8e8-d9930e2eb514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8ebdd69fdb46018098ab82f19d5135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:34:58Z,use_quota=True,user_id='41cec85601844d37921632a5e6e139a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f31ed6f5-74ae-4635-95bc-e55949a12b7a),volume_type_id=f31ed6f5-74ae-4635-95bc-e55949a12b7a)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Creating volume 07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:34:58 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:58 devstack sudo[93274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 1073741824
Sep 08 16:34:58 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:58 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 1073741824" returned: 0 in 0.485s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:34:58 devstack sudo[93281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514
Sep 08 16:34:58 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:34:58 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514" returned: 0 in 0.263s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf23b1d-c922-42d9-b737-9e2fc565a3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07558c82-b784-41ce-a8e8-d9930e2eb514', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5c87f-cb8f-4054-9ccc-abd6fcbc121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:34:58 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Volume volume-07558c82-b784-41ce-a8e8-d9930e2eb514 (07558c82-b784-41ce-a8e8-d9930e2eb514): created successfully
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f5c87f-cb8f-4054-9ccc-abd6fcbc121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:34:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Flow 'volume_create_manager' (ab9e892d-d2b9-4417-8510-e9df50696c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:34:58 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-87d0a707-f206-42b4-870f-f8d2d2e8c989 tempest-GroupsV314Test-787887018 None] Created volume successfully.
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:00 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Cloning volume 07558c82-b784-41ce-a8e8-d9930e2eb514 to volume 75c44d80-e56c-430c-a4ee-47e493d6efb6
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Creating offline snapshot 715d63b6-1ac3-48eb-8781-279e7d3d3405 of volume 07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe763d9-3809-4df6-b400-0b5963cf09b6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:00 devstack sudo[93287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514
Sep 08 16:35:00 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-3ec77d19-e3f8-4522-bb85-79b5a4be4f26 req-a78ca377-c529-4c58-8752-7a7483c94ba3 tempest-AttachVolumeTestJSON-179529324 None] Terminate volume connection completed successfully.
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-3ec77d19-e3f8-4522-bb85-79b5a4be4f26 req-a78ca377-c529-4c58-8752-7a7483c94ba3 tempest-AttachVolumeTestJSON-179529324 None] Deleting attachment 5b4bb308-83b6-4812-95be-be4c827c0b39. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:35:00 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514" returned: 0 in 0.614s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:01 devstack sudo[93294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 1G
Sep 08 16:35:01 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:01 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 1G" returned: 0 in 0.693s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07558c82-b784-41ce-a8e8-d9930e2eb514 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:01 devstack sudo[93302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07558c82-b784-41ce-a8e8-d9930e2eb514 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405
Sep 08 16:35:01 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:02 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07558c82-b784-41ce-a8e8-d9930e2eb514 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405" returned: 0 in 0.459s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:02 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:35:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:02 devstack sudo[93317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405
Sep 08 16:35:02 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:02 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405" returned: 0 in 0.447s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:02 devstack sudo[93324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.info
Sep 08 16:35:02 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:03 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.info" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:03 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:03 devstack sudo[93328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.info
Sep 08 16:35:03 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:03 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.info" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Acquiring lock "cinder-quobyte-75c44d80-e56c-430c-a4ee-47e493d6efb6" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-75c44d80-e56c-430c-a4ee-47e493d6efb6" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] snapshot: 715d63b6-1ac3-48eb-8781-279e7d3d3405, volume: 75c44d80-e56c-430c-a4ee-47e493d6efb6,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf3977-18a7-4df8-9dd5-6abed2c0dd20]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:03 devstack sudo[93331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405
Sep 08 16:35:03 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:03 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405" returned: 0 in 0.431s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07558c82-b784-41ce-a8e8-d9930e2eb514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bba9f5-e133-4c05-b463-6c37afeb2d90]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:04 devstack sudo[93337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514
Sep 08 16:35:04 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:04 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514" returned: 0 in 0.506s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:35:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:35:04 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:35:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:04 devstack sudo[93343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6
Sep 08 16:35:04 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6" returned: 0 in 7.182s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:11 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:35:11 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Converted 1024.00 MB image at 142.56 MB/s
Sep 08 16:35:11 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6 is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:35:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:11 devstack sudo[93476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6
Sep 08 16:35:11 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:11 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6" returned: 0 in 0.413s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-75c44d80-e56c-430c-a4ee-47e493d6efb6" released by "_copy_volume_from_snapshot" :: held 8.641s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Acquiring lock "cinder-quobyte-715d63b6-1ac3-48eb-8781-279e7d3d3405" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-715d63b6-1ac3-48eb-8781-279e7d3d3405" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Deleting offline snapshot 715d63b6-1ac3-48eb-8781-279e7d3d3405 of volume 07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] snapshot_file for this snap is: volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84959c-534e-4c8a-968a-7c563d47bd06]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:12 devstack sudo[93480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405
Sep 08 16:35:12 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:35:12 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405" returned: 0 in 0.578s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07558c82-b784-41ce-a8e8-d9930e2eb514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[43392be5-668c-4314-bfbb-437c2f37beee]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:12 devstack sudo[93485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514
Sep 08 16:35:12 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:13 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514" returned: 0 in 0.550s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:13 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405
Sep 08 16:35:13 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:13 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405" returned: 0 in 0.497s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:13 devstack sudo[93505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405
Sep 08 16:35:13 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:14 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514.715d63b6-1ac3-48eb-8781-279e7d3d3405" returned: 0 in 0.331s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-715d63b6-1ac3-48eb-8781-279e7d3d3405" released by "_delete_snapshot" :: held 2.143s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.974s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-22bbf668-c95c-448c-a1c8-2ad4ee0a174b tempest-GroupsV314Test-787887018 None] Create group from source-group-59db1eaf-4304-4bec-a08b-787af734022f completed successfully.
Sep 08 16:35:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Acquiring lock "cinder-quobyte-75c44d80-e56c-430c-a4ee-47e493d6efb6" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-75c44d80-e56c-430c-a4ee-47e493d6efb6" acquired by "delete_volume" :: waited 0.057s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:15 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a2537a-c7b8-4963-a654-8ed7b306ddeb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:16 devstack sudo[93539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6
Sep 08 16:35:16 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:16 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6" returned: 0 in 0.637s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:16 devstack sudo[93545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6
Sep 08 16:35:16 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:16 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-75c44d80-e56c-430c-a4ee-47e493d6efb6" returned: 0 in 0.372s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-75c44d80-e56c-430c-a4ee-47e493d6efb6" released by "delete_volume" :: held 1.113s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Created reservations ['4a96d49e-6daf-4878-bd0b-27a17028cf1f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:17 devstack cinder-volume[87505]: WARNING cinder.quota [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1258763748 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1258763748, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:35:17 devstack cinder-volume[87505]: WARNING cinder.quota [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1258763748 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1258763748, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Created reservations ['91b6ab90-dfe0-4b86-ad6f-eec99435c18a', '774234d1-245d-4e1f-8c67-6b811ba4a3ca', 'cce94f1d-cae8-4197-961c-961c8217a6af', 'd871a5b3-cd9a-461b-a89a-5f4dddfeeee4'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:17 devstack sudo[93551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:17 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-e350eea7-384c-4779-b747-14aecddcf468 req-3423ae69-1c60-4b6e-ad3a-3d62bfa46489 tempest-ServerActionsTestOtherA-392376613 None] Terminate volume connection completed successfully.
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-e350eea7-384c-4779-b747-14aecddcf468 req-3423ae69-1c60-4b6e-ad3a-3d62bfa46489 tempest-ServerActionsTestOtherA-392376613 None] Deleting attachment 521a1065-191c-4a1e-93b2-214ff9a56195. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:35:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "cinder-e1d076de-4a35-4915-b6c4-53f1568b66fa-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-e1d076de-4a35-4915-b6c4-53f1568b66fa-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "cinder-quobyte-e1d076de-4a35-4915-b6c4-53f1568b66fa" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:18 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-quobyte-e1d076de-4a35-4915-b6c4-53f1568b66fa" acquired by "delete_volume" :: waited 0.044s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.695s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-af4aa896-6a3b-4312-9e78-1570c62638c4 tempest-GroupsV314Test-787887018 None] Delete group completed successfully.
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2638d9-2d47-47a4-9fd2-bf23692e87f6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:18 devstack sudo[93555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa
Sep 08 16:35:18 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Acquiring lock "cinder-quobyte-07558c82-b784-41ce-a8e8-d9930e2eb514" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-07558c82-b784-41ce-a8e8-d9930e2eb514" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6bc392-3a7a-43a5-a769-f96921c999c1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:19 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa" returned: 0 in 0.931s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:19 devstack sudo[93571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa
Sep 08 16:35:19 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:19 devstack sudo[93570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514
Sep 08 16:35:19 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "cinder-2f36c26a-b70e-4032-abfa-f0edb0fba1b9-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-2f36c26a-b70e-4032-abfa-f0edb0fba1b9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "cinder-quobyte-2f36c26a-b70e-4032-abfa-f0edb0fba1b9" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-quobyte-2f36c26a-b70e-4032-abfa-f0edb0fba1b9" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c8795-2068-4f1b-b100-2ae1384ada90]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:19 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1d076de-4a35-4915-b6c4-53f1568b66fa" returned: 0 in 0.725s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-quobyte-e1d076de-4a35-4915-b6c4-53f1568b66fa" released by "delete_volume" :: held 1.756s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:19 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514" returned: 0 in 0.920s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:19 devstack sudo[93582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9
Sep 08 16:35:19 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:20 devstack sudo[93584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514
Sep 08 16:35:20 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.quota [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Created reservations ['b96562d2-27d2-4df7-af4d-f7f5ae330433', '3ed6a75d-6f80-4f35-aa6d-78f93816d0cb', '74bfcd90-6000-4361-aa71-4fad658f73e5', '136499aa-c586-4b01-8c04-428ab9e46532'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:20 devstack sudo[93587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:20 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:20 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9" returned: 0 in 0.669s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:20 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-07558c82-b784-41ce-a8e8-d9930e2eb514" returned: 0 in 0.576s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:20 devstack sudo[93593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9
Sep 08 16:35:20 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Lock "cinder-quobyte-07558c82-b784-41ce-a8e8-d9930e2eb514" released by "delete_volume" :: held 1.592s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:20 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Created reservations ['c9b7fe11-f29e-4423-93b7-a50cdf78235e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.478s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.manager [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Deleted volume successfully.
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-e350eea7-384c-4779-b747-14aecddcf468 req-9dd935c2-2496-45ff-acb4-11fb891cf0a9 tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-e1d076de-4a35-4915-b6c4-53f1568b66fa-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Created reservations ['bb122438-752a-4299-8a21-9c2a91cbf243', 'f28891f7-e6cc-4b5f-b457-7acc0d5c3dd8', 'da682fa8-b599-4beb-85c0-88624b78e175', '44566246-7579-4ded-8b2b-22e298643a4c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:20 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f36c26a-b70e-4032-abfa-f0edb0fba1b9" returned: 0 in 0.507s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-quobyte-2f36c26a-b70e-4032-abfa-f0edb0fba1b9" released by "delete_volume" :: held 1.269s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:21 devstack sudo[93597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:21 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Created reservations ['f0c82bab-e4a5-45f5-b97a-1dc8062c8978', '6aeecfde-8f85-48af-9aa8-41628b685144', '37d75a34-beb3-4a77-bf58-7b565141538e', '9d81aaab-92e1-4115-b138-8cc4ef3d3b84'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:21 devstack sudo[93599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:21 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:21 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.325s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-24009999-262f-425c-86d5-ed239701d3b6 tempest-GroupsV314Test-787887018 None] Delete group completed successfully.
Sep 08 16:35:21 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.318s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Deleted volume successfully.
Sep 08 16:35:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2058f0d6-1dfa-47e9-bc3d-77ff8ee0a12e tempest-ServerActionsTestOtherA-392376613 None] Lock "cinder-2f36c26a-b70e-4032-abfa-f0edb0fba1b9-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:31 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=41,cinder:UPDATE=47,cinder:INSERT=9 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:35:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5abc04fe-a498-42ba-b463-4a421fa80bc3 tempest-GroupsV320Test-2134831596 None] Group tempest-GroupsV320Test-Group-1351238458: creating
Sep 08 16:35:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5abc04fe-a498-42ba-b463-4a421fa80bc3 tempest-GroupsV320Test-2134831596 None] Group tempest-GroupsV320Test-Group-1351238458: created successfully
Sep 08 16:35:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5abc04fe-a498-42ba-b463-4a421fa80bc3 tempest-GroupsV320Test-2134831596 None] Create group completed successfully.
Sep 08 16:35:33 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Created reservations ['51b02858-37e7-41b8-b4c6-4a15cc09f87e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:33 devstack sudo[93752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:33 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:34 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:34 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9019d9cb-ac2f-4718-878d-48999035c72e tempest-GroupsV320Test-2134831596 None] Delete group completed successfully.
Sep 08 16:35:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9117ec76-8a8f-40fe-9cc9-c2f976e9b171 tempest-GroupSnapshotsV319Test-1856131600 None] Group tempest-GroupSnapshotsV319Test-Group-1933105103: creating
Sep 08 16:35:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9117ec76-8a8f-40fe-9cc9-c2f976e9b171 tempest-GroupSnapshotsV319Test-1856131600 None] Group tempest-GroupSnapshotsV319Test-Group-1933105103: created successfully
Sep 08 16:35:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9117ec76-8a8f-40fe-9cc9-c2f976e9b171 tempest-GroupSnapshotsV319Test-1856131600 None] Create group completed successfully.
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Flow 'volume_create_manager' (d5489cbc-6b6a-4b63-bddc-2daca00c389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7deed9d-5f1f-4b9d-bf63-ec1d8d6354c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7deed9d-5f1f-4b9d-bf63-ec1d8d6354c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1451032554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc018d6a-1e49-4236-8d25-b30b90309429,host='devstack@QuobyteHD#QuobyteHD',id=df3e61d9-fd49-42a7-bad3-a0338909d9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892e3dc167bd4b45af9f37bcc6cada21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:35:41Z,use_quota=True,user_id='6daf0024c6ec4939a980a741430858e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(566de4ca-807c-4151-a552-53ce713c10db),volume_type_id=566de4ca-807c-4151-a552-53ce713c10db)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafa63e3-dab4-4e5b-8db2-226da73cb93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafa63e3-dab4-4e5b-8db2-226da73cb93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0352f2b4-053f-4b25-bcc4-6666948d6d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0352f2b4-053f-4b25-bcc4-6666948d6d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3e61d9-fd49-42a7-bad3-a0338909d9f7', 'volume_name': 'volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44124990-5f6f-47af-b7d2-c50091254709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44124990-5f6f-47af-b7d2-c50091254709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c650683-b9ce-49fe-a2c1-d55f2726181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:40 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Volume df3e61d9-fd49-42a7-bad3-a0338909d9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7', 'volume_size': 1}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cc018d6a-1e49-4236-8d25-b30b90309429,created_at=2026-09-08T14:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1451032554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cc018d6a-1e49-4236-8d25-b30b90309429,host='devstack@QuobyteHD#QuobyteHD',id=df3e61d9-fd49-42a7-bad3-a0338909d9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='892e3dc167bd4b45af9f37bcc6cada21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:35:41Z,use_quota=True,user_id='6daf0024c6ec4939a980a741430858e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(566de4ca-807c-4151-a552-53ce713c10db),volume_type_id=566de4ca-807c-4151-a552-53ce713c10db)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Creating volume df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:35:40 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:35:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:40 devstack sudo[93776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 1073741824
Sep 08 16:35:40 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:41 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 1073741824" returned: 0 in 0.515s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:41 devstack sudo[93785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7
Sep 08 16:35:41 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:41 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c650683-b9ce-49fe-a2c1-d55f2726181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf883a72-e569-4af9-a1d7-561ee24cb3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:41 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Volume volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 (df3e61d9-fd49-42a7-bad3-a0338909d9f7): created successfully
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf883a72-e569-4af9-a1d7-561ee24cb3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Flow 'volume_create_manager' (d5489cbc-6b6a-4b63-bddc-2daca00c389f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:35:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3ee784b1-087e-43b0-9922-287669c68b61 tempest-GroupSnapshotsV319Test-1856131600 None] Created volume successfully.
Sep 08 16:35:42 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] GroupSnapshot 75be3ed2-a2b1-429e-8513-47b306927999: creating.
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Group snapshot 75be3ed2-a2b1-429e-8513-47b306927999: creating. {{(pid=87505) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Creating offline snapshot a9d502d8-2664-45b3-b13b-2f1aec8a6e1b of volume df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e602c9-2715-40e2-bd7a-3e881d9e1120]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:42 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7
Sep 08 16:35:42 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:42 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7" returned: 0 in 0.493s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:42 devstack sudo[93794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b 1G
Sep 08 16:35:42 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:43 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b 1G" returned: 0 in 0.589s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:43 devstack sudo[93813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b
Sep 08 16:35:43 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:43 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" returned: 0 in 0.416s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:43 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:35:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:43 devstack sudo[93821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b
Sep 08 16:35:43 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:44 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" returned: 0 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:44 devstack sudo[93824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.info
Sep 08 16:35:44 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:44 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.info" returned: 0 in 0.293s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:44 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:35:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:44 devstack sudo[93827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.info
Sep 08 16:35:44 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:44 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.info" returned: 0 in 0.311s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:45 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a0e053e5-cb7b-42f8-80d8-e8d2848e084a tempest-GroupSnapshotsV319Test-1856131600 None] group_snapshot 75be3ed2-a2b1-429e-8513-47b306927999: created successfully
Sep 08 16:35:46 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] group_snapshot 75be3ed2-a2b1-429e-8513-47b306927999: deleting
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] group_snapshot 75be3ed2-a2b1-429e-8513-47b306927999: deleting {{(pid=87505) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Acquiring lock "cinder-quobyte-df3e61d9-fd49-42a7-bad3-a0338909d9f7" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "cinder-quobyte-df3e61d9-fd49-42a7-bad3-a0338909d9f7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Acquiring lock "cinder-quobyte-a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "cinder-quobyte-a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Deleting offline snapshot a9d502d8-2664-45b3-b13b-2f1aec8a6e1b of volume df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] snapshot_file for this snap is: volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5935e319-4fba-4430-bf12-55fe5503f953]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:46 devstack sudo[93831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b
Sep 08 16:35:46 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:47 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" returned: 0 in 0.723s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:35:47 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fc064a-372a-40b6-8adc-3d519fe8ad5f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:47 devstack sudo[93878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7
Sep 08 16:35:47 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:48 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7" returned: 0 in 0.809s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:48 devstack sudo[93919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b
Sep 08 16:35:48 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:48 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" returned: 0 in 0.526s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:48 devstack sudo[93951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b
Sep 08 16:35:48 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:49 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7.a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" returned: 0 in 0.516s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "cinder-quobyte-a9d502d8-2664-45b3-b13b-2f1aec8a6e1b" released by "_delete_snapshot" :: held 2.799s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Lock "cinder-quobyte-df3e61d9-fd49-42a7-bad3-a0338909d9f7" released by "delete_snapshot" :: held 2.853s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:49 devstack cinder-volume[87505]: WARNING cinder.quota [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1811527756 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1811527756, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:35:49 devstack cinder-volume[87505]: WARNING cinder.quota [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1811527756 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1811527756, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] Created reservations ['301ef68e-92c2-4395-ad79-6a162441102a', 'b8ae6ba9-0df3-4e88-9469-36d34eeb9f94', 'a0f27278-1275-4650-b192-0d3bca7797d6', '3da472ec-71ba-488e-9f33-e9a340ab1862'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3639f205-995d-4daf-b6f9-cc6628cf31d5 tempest-GroupSnapshotsV319Test-1856131600 None] group_snapshot 75be3ed2-a2b1-429e-8513-47b306927999: deleted successfully
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Flow 'volume_create_manager' (82339a10-4c57-4028-931c-6e452e3dd5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae81b28-fd2a-4623-9712-7bda608e9045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ae81b28-fd2a-4623-9712-7bda608e9045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1222676587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd057622-4101-4603-8fd6-51fd3dcafbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cb1800174f403c8371cf62456ad3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:35:49Z,use_quota=True,user_id='ed989d06607945d59d5eda17b7a060fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44717598-5996-4102-9807-69c5b63a468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44717598-5996-4102-9807-69c5b63a468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb17d91-5659-45a6-a1b3-a1a31d8058a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb17d91-5659-45a6-a1b3-a1a31d8058a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd057622-4101-4603-8fd6-51fd3dcafbf1', 'volume_name': 'volume-dd057622-4101-4603-8fd6-51fd3dcafbf1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574e40de-3e9c-4b79-924d-0cfdeb81d777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574e40de-3e9c-4b79-924d-0cfdeb81d777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00e7b84-56fb-4805-bd0a-854f2bf28101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Volume dd057622-4101-4603-8fd6-51fd3dcafbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd057622-4101-4603-8fd6-51fd3dcafbf1', 'volume_size': 1}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1222676587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd057622-4101-4603-8fd6-51fd3dcafbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cb1800174f403c8371cf62456ad3c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:35:49Z,use_quota=True,user_id='ed989d06607945d59d5eda17b7a060fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Creating volume dd057622-4101-4603-8fd6-51fd3dcafbf1 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:35:49 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:35:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:49 devstack sudo[93956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1 1073741824
Sep 08 16:35:49 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Acquiring lock "cinder-quobyte-df3e61d9-fd49-42a7-bad3-a0338909d9f7" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Lock "cinder-quobyte-df3e61d9-fd49-42a7-bad3-a0338909d9f7" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d12731-2747-468e-bd10-7a00e87bd6c5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:50 devstack sudo[93962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7
Sep 08 16:35:50 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:50 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1 1073741824" returned: 0 in 0.743s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:50 devstack sudo[93964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1
Sep 08 16:35:50 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:50 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7" returned: 0 in 0.574s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:50 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1" returned: 0 in 0.379s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:50 devstack sudo[93970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7
Sep 08 16:35:50 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00e7b84-56fb-4805-bd0a-854f2bf28101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd057622-4101-4603-8fd6-51fd3dcafbf1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5694a90-e44f-42f3-8d24-855f30ef8e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:50 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Volume volume-dd057622-4101-4603-8fd6-51fd3dcafbf1 (dd057622-4101-4603-8fd6-51fd3dcafbf1): created successfully
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5694a90-e44f-42f3-8d24-855f30ef8e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Flow 'volume_create_manager' (82339a10-4c57-4028-931c-6e452e3dd5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:35:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3afc8b3f-111b-4fbe-9c64-75aee86ced9f tempest-AttachVolumeShelveTestJSON-531892175 None] Created volume successfully.
Sep 08 16:35:51 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-df3e61d9-fd49-42a7-bad3-a0338909d9f7" returned: 0 in 0.450s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Lock "cinder-quobyte-df3e61d9-fd49-42a7-bad3-a0338909d9f7" released by "delete_volume" :: held 1.163s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Flow 'volume_create_manager' (aa19cb12-4422-45dd-9237-ef1790ff0f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864aec1e-a7a8-4fa4-9f5c-6e83dd2c5a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864aec1e-a7a8-4fa4-9f5c-6e83dd2c5a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-376195513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfde6ae-20ff-43f2-90e2-da8ebbf864a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04717c688f1c4f52ad78690d497ea86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:35:51Z,use_quota=True,user_id='30d4d2c0df4244188dc3acd808929d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c84b9d82-8f83-46c3-a3ae-515535a636d3),volume_type_id=c84b9d82-8f83-46c3-a3ae-515535a636d3)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515253fb-6de7-4674-8037-e4a3347ed06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515253fb-6de7-4674-8037-e4a3347ed06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930f54a6-83d0-41e2-9e58-1990e1c6bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930f54a6-83d0-41e2-9e58-1990e1c6bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abfde6ae-20ff-43f2-90e2-da8ebbf864a5', 'volume_name': 'volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65914d12-d6e1-4314-a9ce-6f5d46dc920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65914d12-d6e1-4314-a9ce-6f5d46dc920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cfc86b-25ec-40d0-a54a-67b0b6c3e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:51 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Volume abfde6ae-20ff-43f2-90e2-da8ebbf864a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5', 'volume_size': 1}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-376195513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfde6ae-20ff-43f2-90e2-da8ebbf864a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04717c688f1c4f52ad78690d497ea86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:35:51Z,use_quota=True,user_id='30d4d2c0df4244188dc3acd808929d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c84b9d82-8f83-46c3-a3ae-515535a636d3),volume_type_id=c84b9d82-8f83-46c3-a3ae-515535a636d3)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Creating volume abfde6ae-20ff-43f2-90e2-da8ebbf864a5 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:35:51 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:51 devstack sudo[93973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5 1073741824
Sep 08 16:35:51 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Created reservations ['3cf084d1-8c7a-484b-a689-98e3e6d40312'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:51 devstack cinder-volume[87505]: WARNING cinder.quota [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1811527756 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1811527756, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Created reservations ['622d3cf3-5bfc-4f90-a36e-c74c89f5fc3b', '1c87c8f7-72ea-4252-8dce-0ea5c2f7270f', '6c7ed643-e588-4372-8458-dd27cc5695fe', 'd7b875a1-9e5f-49dc-a065-83d693b8c0c7'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:51 devstack sudo[93983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:51 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:52 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:52 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5 1073741824" returned: 0 in 0.762s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-628bac8e-5e4b-4b85-92ff-f8a4c620e5eb tempest-GroupSnapshotsV319Test-1856131600 None] Delete group completed successfully.
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:52 devstack sudo[93986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5
Sep 08 16:35:52 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:52 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cfc86b-25ec-40d0-a54a-67b0b6c3e12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50760343-fb42-4e4a-ad7c-2ed5c63a823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:35:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Volume volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5 (abfde6ae-20ff-43f2-90e2-da8ebbf864a5): created successfully
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50760343-fb42-4e4a-ad7c-2ed5c63a823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:35:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Flow 'volume_create_manager' (aa19cb12-4422-45dd-9237-ef1790ff0f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:35:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6bc4d851-080f-4677-bf09-6715991e0c02 tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Created volume successfully.
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:54 devstack sudo[93999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:54 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:54 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:54 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4f59c2de-b1fd-4c7b-8119-676d86fd2b1f tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Retype volume completed successfully.
Sep 08 16:35:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Acquiring lock "cinder-abfde6ae-20ff-43f2-90e2-da8ebbf864a5-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "cinder-abfde6ae-20ff-43f2-90e2-da8ebbf864a5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Acquiring lock "cinder-quobyte-abfde6ae-20ff-43f2-90e2-da8ebbf864a5" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:35:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "cinder-quobyte-abfde6ae-20ff-43f2-90e2-da8ebbf864a5" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:35:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6005a8ed-4f45-49e2-bd66-6f8b9c72e6d4]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:35:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:55 devstack sudo[94011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5
Sep 08 16:35:55 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:56 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5" returned: 0 in 0.437s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:56 devstack sudo[94016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5
Sep 08 16:35:56 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:56 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-abfde6ae-20ff-43f2-90e2-da8ebbf864a5" returned: 0 in 0.453s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "cinder-quobyte-abfde6ae-20ff-43f2-90e2-da8ebbf864a5" released by "delete_volume" :: held 0.980s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:56 devstack sudo[94019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:56 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:56 devstack cinder-volume[87505]: WARNING cinder.quota [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:35:56 devstack cinder-volume[87505]: WARNING cinder.quota [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Created reservations ['1afea3c8-224e-4a2d-9eaf-0b4cd51d6e3a', 'afae2f2c-db5c-4d0d-a587-5d6094930fd1', '4f8f51fb-8352-469f-85cf-5873a61618e8', 'e3d0000b-1445-424b-9fa5-cad83327c89f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:35:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:35:56 devstack sudo[94021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:35:56 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:35:57 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.441s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:35:57 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.418s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:35:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Deleted volume successfully.
Sep 08 16:35:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32f8ef9f-255d-43d8-bf4b-bbcc7ebcbaec tempest-VolumeRetypeWithoutMigrationTest-1033726798 None] Lock "cinder-abfde6ae-20ff-43f2-90e2-da8ebbf864a5-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-5c595add-15cb-4e71-8e56-40809cbe3c5c req-5662f8bf-a658-413f-a4b9-c9c15911d5a1 tempest-AttachVolumeShelveTestJSON-531892175 None] No connector for attachment 3abca243-c985-4d27-bb92-59ec467e836e; skipping storage backend terminate_connection call. {{(pid=87505) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 08 16:36:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-5c595add-15cb-4e71-8e56-40809cbe3c5c req-5662f8bf-a658-413f-a4b9-c9c15911d5a1 tempest-AttachVolumeShelveTestJSON-531892175 None] Deleting attachment 3abca243-c985-4d27-bb92-59ec467e836e. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Flow 'volume_create_manager' (eda81ae9-6fc0-4502-907d-8306a9c23c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e504886c-e440-4862-9975-5857da21e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e504886c-e440-4862-9975-5857da21e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-392921027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8884728e-c4f3-435d-b902-81e21bd0cfbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df69f3a2105400abe878ac73a7ae634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:06Z,use_quota=True,user_id='3d92effc92334f58a3de06762666fc34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4612e790-ba2a-4b49-b254-a14f38ee0129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4612e790-ba2a-4b49-b254-a14f38ee0129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411c7ec7-b2f6-4290-9f8f-338fe4faf631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411c7ec7-b2f6-4290-9f8f-338fe4faf631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8884728e-c4f3-435d-b902-81e21bd0cfbc', 'volume_name': 'volume-8884728e-c4f3-435d-b902-81e21bd0cfbc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1048cd-0beb-459d-8805-4c8ed5de7b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1048cd-0beb-459d-8805-4c8ed5de7b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823f174a-7ece-405e-af12-41cccb6a1e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:06 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Volume 8884728e-c4f3-435d-b902-81e21bd0cfbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8884728e-c4f3-435d-b902-81e21bd0cfbc', 'volume_size': 1}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-392921027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8884728e-c4f3-435d-b902-81e21bd0cfbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df69f3a2105400abe878ac73a7ae634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:06Z,use_quota=True,user_id='3d92effc92334f58a3de06762666fc34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Creating volume 8884728e-c4f3-435d-b902-81e21bd0cfbc {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:06 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:06 devstack sudo[94072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc 1073741824
Sep 08 16:36:06 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:07 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc 1073741824" returned: 0 in 0.529s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:07 devstack sudo[94078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc
Sep 08 16:36:07 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:07 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc" returned: 0 in 0.298s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823f174a-7ece-405e-af12-41cccb6a1e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8884728e-c4f3-435d-b902-81e21bd0cfbc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbbc175-e42f-4682-b9ec-947acf5d69d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Volume volume-8884728e-c4f3-435d-b902-81e21bd0cfbc (8884728e-c4f3-435d-b902-81e21bd0cfbc): created successfully
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbbc175-e42f-4682-b9ec-947acf5d69d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Flow 'volume_create_manager' (eda81ae9-6fc0-4502-907d-8306a9c23c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9c05ce84-6833-4c55-bde3-261dbd8c040c tempest-VolumesServicesTestJSON-1955948532 None] Created volume successfully.
Sep 08 16:36:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Acquiring lock "cinder-8884728e-c4f3-435d-b902-81e21bd0cfbc-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Lock "cinder-8884728e-c4f3-435d-b902-81e21bd0cfbc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Acquiring lock "cinder-quobyte-8884728e-c4f3-435d-b902-81e21bd0cfbc" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Lock "cinder-quobyte-8884728e-c4f3-435d-b902-81e21bd0cfbc" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4136829d-aa7d-4a2c-8dae-f4661b2b85f0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:09 devstack sudo[94088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc
Sep 08 16:36:09 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:09 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc" returned: 0 in 0.581s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:09 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc
Sep 08 16:36:09 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:09 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8884728e-c4f3-435d-b902-81e21bd0cfbc" returned: 0 in 0.315s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Lock "cinder-quobyte-8884728e-c4f3-435d-b902-81e21bd0cfbc" released by "delete_volume" :: held 0.965s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Created reservations ['bb638253-811b-4af6-9329-045fcbf8d356', '80174b79-0a96-4b33-af16-528861eb2c37', '88d0ef20-4c84-47af-af0f-5d27f2523f1f', 'a62f482d-c51d-49db-9191-c439a22412f9'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:10 devstack sudo[94097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:10 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:10 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Deleted volume successfully.
Sep 08 16:36:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bbce550b-afa2-4d1d-99e9-0b3bec0fbe8f tempest-VolumesServicesTestJSON-1955948532 None] Lock "cinder-8884728e-c4f3-435d-b902-81e21bd0cfbc-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=91,cinder:SELECT=84,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Flow 'volume_create_manager' (00b39e3e-325b-4b22-921a-99ae85e4a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a513d18-ba0e-4411-b062-8c4bc81e21de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a513d18-ba0e-4411-b062-8c4bc81e21de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-284996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45eda9a1-0e78-4c1a-83e7-9f566713ad4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5946c8a613e4e54858cabf6f2ae6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:13Z,use_quota=True,user_id='255a08978f0a42caa0e4e728dd4acd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04162c6-914f-48b7-ba49-ad839909c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04162c6-914f-48b7-ba49-ad839909c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2df43b-8f39-4976-96a2-198d0ac4d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb2df43b-8f39-4976-96a2-198d0ac4d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45eda9a1-0e78-4c1a-83e7-9f566713ad4b', 'volume_name': 'volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7d0bae-5f9c-40b2-8502-b80367442fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7d0bae-5f9c-40b2-8502-b80367442fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82afcf25-1dc2-467c-9587-4a6977a6fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:12 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Volume 45eda9a1-0e78-4c1a-83e7-9f566713ad4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b', 'volume_size': 1}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-284996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45eda9a1-0e78-4c1a-83e7-9f566713ad4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5946c8a613e4e54858cabf6f2ae6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:13Z,use_quota=True,user_id='255a08978f0a42caa0e4e728dd4acd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Creating volume 45eda9a1-0e78-4c1a-83e7-9f566713ad4b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:12 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:12 devstack sudo[94138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b 1073741824
Sep 08 16:36:12 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b 1073741824" returned: 0 in 0.864s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:13 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:14 devstack sudo[94207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b
Sep 08 16:36:14 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:14 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b" returned: 0 in 0.448s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82afcf25-1dc2-467c-9587-4a6977a6fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6b6468-4644-431d-8931-b1f3581c56e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Volume volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b (45eda9a1-0e78-4c1a-83e7-9f566713ad4b): created successfully
Sep 08 16:36:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6b6468-4644-431d-8931-b1f3581c56e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Flow 'volume_create_manager' (00b39e3e-325b-4b22-921a-99ae85e4a87b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b6da5926-8644-4b8d-824b-9339f57033b3 tempest-AttachVolumeTestJSON-179529324 None] Created volume successfully.
Sep 08 16:36:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-ca8dcb6c-4aab-413b-89a2-f6c5bd3ab7b9 req-49850c73-d31e-44de-ba95-7936cd03fb89 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-ca8dcb6c-4aab-413b-89a2-f6c5bd3ab7b9 req-49850c73-d31e-44de-ba95-7936cd03fb89 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-ca8dcb6c-4aab-413b-89a2-f6c5bd3ab7b9 req-49850c73-d31e-44de-ba95-7936cd03fb89 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-ca8dcb6c-4aab-413b-89a2-f6c5bd3ab7b9 req-49850c73-d31e-44de-ba95-7936cd03fb89 tempest-AttachVolumeTestJSON-179529324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63521883-999c-4b39-b396-77eb0cd1b3f6', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:36:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-ca8dcb6c-4aab-413b-89a2-f6c5bd3ab7b9 req-49850c73-d31e-44de-ba95-7936cd03fb89 tempest-AttachVolumeTestJSON-179529324 None] attachment_update completed successfully.
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Flow 'volume_create_manager' (3f7d3c8f-682b-43b3-afc7-d0fb77dc67af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1a8b2a-05e9-49a1-ad71-e3fc3b78e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1a8b2a-05e9-49a1-ad71-e3fc3b78e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2137629954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b42f4c-87e0-4843-ad54-67b4ca4940d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5946c8a613e4e54858cabf6f2ae6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:20Z,use_quota=True,user_id='255a08978f0a42caa0e4e728dd4acd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9ebd92-131f-4cfd-8be8-e6fb69dc34f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb9ebd92-131f-4cfd-8be8-e6fb69dc34f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34f68b4-f856-4023-af8e-6c173a5d3fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34f68b4-f856-4023-af8e-6c173a5d3fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b42f4c-87e0-4843-ad54-67b4ca4940d1', 'volume_name': 'volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77ca39a-1554-4e8d-8bdd-e6ae358334dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77ca39a-1554-4e8d-8bdd-e6ae358334dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f9dab-74ce-4416-8983-25a72e41a594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:19 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Volume 59b42f4c-87e0-4843-ad54-67b4ca4940d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1', 'volume_size': 1}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2137629954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b42f4c-87e0-4843-ad54-67b4ca4940d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5946c8a613e4e54858cabf6f2ae6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:20Z,use_quota=True,user_id='255a08978f0a42caa0e4e728dd4acd95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Creating volume 59b42f4c-87e0-4843-ad54-67b4ca4940d1 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:19 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:19 devstack sudo[94613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1 1073741824
Sep 08 16:36:19 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:20 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1 1073741824" returned: 0 in 0.642s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:20 devstack sudo[94619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1
Sep 08 16:36:20 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:20 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Flow 'volume_create_manager' (b3d14a93-2abb-4b4d-8e6a-dd78e07885ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4fd420-faa8-4980-a2b0-d2c605a92aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1" returned: 0 in 0.367s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4fd420-faa8-4980-a2b0-d2c605a92aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-647840892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330925fc-cef9-4023-b25a-20031e5b78cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fcda69419c41bfa65547d33132f2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:21Z,use_quota=True,user_id='161579cf91c740158c4d9e4c63722ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfd6f1c-afe2-46a5-89b1-ed90ec005109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfd6f1c-afe2-46a5-89b1-ed90ec005109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c59bf31-3bac-41f4-b02f-5ee9c4683a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c59bf31-3bac-41f4-b02f-5ee9c4683a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330925fc-cef9-4023-b25a-20031e5b78cc', 'volume_name': 'volume-330925fc-cef9-4023-b25a-20031e5b78cc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb22d0d-1bf1-4030-8fdd-b73b4221f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb22d0d-1bf1-4030-8fdd-b73b4221f56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0223cf70-ea79-4577-8116-d1dc5048eeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Volume 330925fc-cef9-4023-b25a-20031e5b78cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330925fc-cef9-4023-b25a-20031e5b78cc', 'volume_size': 1}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-647840892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330925fc-cef9-4023-b25a-20031e5b78cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fcda69419c41bfa65547d33132f2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:21Z,use_quota=True,user_id='161579cf91c740158c4d9e4c63722ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Creating volume 330925fc-cef9-4023-b25a-20031e5b78cc {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:20 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2f9dab-74ce-4416-8983-25a72e41a594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87101cb-9418-4e99-ab1f-209c09901d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:20 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc 1073741824
Sep 08 16:36:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Volume volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1 (59b42f4c-87e0-4843-ad54-67b4ca4940d1): created successfully
Sep 08 16:36:20 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87101cb-9418-4e99-ab1f-209c09901d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Flow 'volume_create_manager' (3f7d3c8f-682b-43b3-afc7-d0fb77dc67af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f15b59c2-543e-4741-b164-b30460f59fbe tempest-AttachVolumeTestJSON-179529324 None] Created volume successfully.
Sep 08 16:36:21 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc 1073741824" returned: 0 in 0.482s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:21 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc
Sep 08 16:36:21 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:21 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc" returned: 0 in 0.281s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0223cf70-ea79-4577-8116-d1dc5048eeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330925fc-cef9-4023-b25a-20031e5b78cc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d402ba2e-8fe3-4a2e-94d7-0a9eec5e7820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Volume volume-330925fc-cef9-4023-b25a-20031e5b78cc (330925fc-cef9-4023-b25a-20031e5b78cc): created successfully
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d402ba2e-8fe3-4a2e-94d7-0a9eec5e7820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Flow 'volume_create_manager' (b3d14a93-2abb-4b4d-8e6a-dd78e07885ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-230e762b-6bdc-47af-9485-a08225dcce80 tempest-VolumeQuotasAdminTestJSON-152001865 None] Created volume successfully.
Sep 08 16:36:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e7927939-65aa-46b7-aacb-0a32492366c2 req-37c13d25-e9f3-490b-9d82-44c74af257e2 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e7927939-65aa-46b7-aacb-0a32492366c2 req-37c13d25-e9f3-490b-9d82-44c74af257e2 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-e7927939-65aa-46b7-aacb-0a32492366c2 req-37c13d25-e9f3-490b-9d82-44c74af257e2 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-e7927939-65aa-46b7-aacb-0a32492366c2 req-37c13d25-e9f3-490b-9d82-44c74af257e2 tempest-AttachVolumeTestJSON-179529324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac27ed2a-e9f3-4494-96fe-78ea61016ac0', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:36:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-e7927939-65aa-46b7-aacb-0a32492366c2 req-37c13d25-e9f3-490b-9d82-44c74af257e2 tempest-AttachVolumeTestJSON-179529324 None] attachment_update completed successfully.
Sep 08 16:36:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Acquiring lock "cinder-330925fc-cef9-4023-b25a-20031e5b78cc-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "cinder-330925fc-cef9-4023-b25a-20031e5b78cc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Acquiring lock "cinder-quobyte-330925fc-cef9-4023-b25a-20031e5b78cc" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "cinder-quobyte-330925fc-cef9-4023-b25a-20031e5b78cc" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f163ea02-0d5b-48fe-a1f8-da54bdf469ce]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:23 devstack sudo[94646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc
Sep 08 16:36:23 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:23 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc" returned: 0 in 0.582s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:23 devstack sudo[94651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc
Sep 08 16:36:23 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:23 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-330925fc-cef9-4023-b25a-20031e5b78cc" returned: 0 in 0.282s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "cinder-quobyte-330925fc-cef9-4023-b25a-20031e5b78cc" released by "delete_volume" :: held 0.931s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Created reservations ['1ca0913a-4fac-48dd-84ec-5aedab63be25', '2eb7db06-caa0-499c-b0dc-3346df8b8063', '4a5bf6d3-d58e-44ed-806b-13d32a04aa62', '8987f499-56fa-4c3b-b3a5-3945c6e4470b'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:24 devstack sudo[94654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:24 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:24 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.364s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Deleted volume successfully.
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dd67a598-ac1e-4eb4-9a36-8f77f18c6039 tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "cinder-330925fc-cef9-4023-b25a-20031e5b78cc-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Flow 'volume_create_manager' (7ba49801-6250-4b18-a6bb-faceee6e9254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7f4a89-60bc-4375-b4ca-15f7dc7b20e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea7f4a89-60bc-4375-b4ca-15f7dc7b20e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1991845869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c56c15-2d0e-4d9b-acec-a478cf536e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fcda69419c41bfa65547d33132f2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:25Z,use_quota=True,user_id='161579cf91c740158c4d9e4c63722ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd252ca-0f96-4ec4-a303-ff1d92d50cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd252ca-0f96-4ec4-a303-ff1d92d50cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14980752-2c6d-42c9-89fa-23aa7fccd944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14980752-2c6d-42c9-89fa-23aa7fccd944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c56c15-2d0e-4d9b-acec-a478cf536e0f', 'volume_name': 'volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985badd5-a915-4560-a46b-f1ea1c7602d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985badd5-a915-4560-a46b-f1ea1c7602d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc35116-65dd-49fe-b183-4ca5df8fc09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:24 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Volume 77c56c15-2d0e-4d9b-acec-a478cf536e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f', 'volume_size': 1}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1991845869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c56c15-2d0e-4d9b-acec-a478cf536e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1fcda69419c41bfa65547d33132f2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:25Z,use_quota=True,user_id='161579cf91c740158c4d9e4c63722ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Creating volume 77c56c15-2d0e-4d9b-acec-a478cf536e0f {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:25 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:25 devstack sudo[94659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f 1073741824
Sep 08 16:36:25 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:25 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f 1073741824" returned: 0 in 0.625s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:25 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f
Sep 08 16:36:25 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-a1ab350f-a66f-4eca-a5c2-c79b6cbaa6ac req-09fd8f86-ccdd-4a4a-9121-04c71db91a27 tempest-AttachVolumeTestJSON-179529324 None] Terminate volume connection completed successfully.
Sep 08 16:36:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-a1ab350f-a66f-4eca-a5c2-c79b6cbaa6ac req-09fd8f86-ccdd-4a4a-9121-04c71db91a27 tempest-AttachVolumeTestJSON-179529324 None] Deleting attachment 63521883-999c-4b39-b396-77eb0cd1b3f6. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:36:26 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fc35116-65dd-49fe-b183-4ca5df8fc09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68ed661-560e-4460-af3c-6ab1914b46b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:26 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Volume volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f (77c56c15-2d0e-4d9b-acec-a478cf536e0f): created successfully
Sep 08 16:36:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68ed661-560e-4460-af3c-6ab1914b46b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Flow 'volume_create_manager' (7ba49801-6250-4b18-a6bb-faceee6e9254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d27c1e59-1948-420f-9c16-79aae101d04e tempest-VolumeQuotasAdminTestJSON-152001865 None] Created volume successfully.
Sep 08 16:36:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-54ae634b-2580-4fc4-811e-e90b906535a6 req-4a43d232-764d-4773-80da-ebbceb2831f1 tempest-AttachVolumeTestJSON-179529324 None] Terminate volume connection completed successfully.
Sep 08 16:36:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-54ae634b-2580-4fc4-811e-e90b906535a6 req-4a43d232-764d-4773-80da-ebbceb2831f1 tempest-AttachVolumeTestJSON-179529324 None] Deleting attachment ac27ed2a-e9f3-4494-96fe-78ea61016ac0. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:36:28 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e0ef413d-ae24-4e49-963c-58eab813e4f6 tempest-VolumeQuotasAdminTestJSON-900086646 None] Transfer volume completed successfully.
Sep 08 16:36:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Acquiring lock "cinder-77c56c15-2d0e-4d9b-acec-a478cf536e0f-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Lock "cinder-77c56c15-2d0e-4d9b-acec-a478cf536e0f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Acquiring lock "cinder-quobyte-77c56c15-2d0e-4d9b-acec-a478cf536e0f" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Lock "cinder-quobyte-77c56c15-2d0e-4d9b-acec-a478cf536e0f" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:28 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad2e8cb-6cfe-48b8-8f00-0bbe8d2a4d66]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:28 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f
Sep 08 16:36:28 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:29 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f" returned: 0 in 0.412s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:29 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f
Sep 08 16:36:29 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:29 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-77c56c15-2d0e-4d9b-acec-a478cf536e0f" returned: 0 in 0.469s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Lock "cinder-quobyte-77c56c15-2d0e-4d9b-acec-a478cf536e0f" released by "delete_volume" :: held 0.940s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Created reservations ['6001c554-9b3c-46d9-bed3-20f236170023', '99b9977a-d7ea-44b8-867f-553f42825b9a', 'aed44264-6396-48a9-a9e3-af70b9b12e84', '529f76cc-3c69-48ab-8ed2-a1cc32d3c2a1'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:29 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:29 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:30 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.328s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Deleted volume successfully.
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cd990b7d-82ae-4e8e-8e34-f01543a83d58 tempest-VolumeQuotasAdminTestJSON-1262531834 None] Lock "cinder-77c56c15-2d0e-4d9b-acec-a478cf536e0f-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Flow 'volume_create_manager' (501bcf8f-8cec-4a44-9360-f57284571045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8351a8f5-30d4-4822-9f3b-c1caa63bccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8351a8f5-30d4-4822-9f3b-c1caa63bccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1873310048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d0039c-05e0-4af3-b215-5f438c49ac57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea13c074bf14ba7aefb7ad890c3a28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:31Z,use_quota=True,user_id='3ef9a73bff2d407c88d018c36ff05bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f62562-a850-439d-8a78-ef41321a464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f62562-a850-439d-8a78-ef41321a464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2947e39-23bf-4ada-a41a-ab348ae9d093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:30 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2947e39-23bf-4ada-a41a-ab348ae9d093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45d0039c-05e0-4af3-b215-5f438c49ac57', 'volume_name': 'volume-45d0039c-05e0-4af3-b215-5f438c49ac57', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440877e60>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc4887b-132f-4f9d-b623-e8b4a01f9567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc4887b-132f-4f9d-b623-e8b4a01f9567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f90d3a-639f-42b6-8f30-a04a064bf10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:31 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Volume 45d0039c-05e0-4af3-b215-5f438c49ac57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45d0039c-05e0-4af3-b215-5f438c49ac57', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440877e60>}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Trying to clone 45d0039c-05e0-4af3-b215-5f438c49ac57 from image 9bf04763-a04a-46d0-817b-b7085cff6448 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:36:31 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Image download 20.69 MB at 20.69 MB/s
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=92,cinder:UPDATE=88,cinder:INSERT=17,cinder:DELETE=8 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a44cb00-4275-4257-a14c-08f81b2b2765]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:31 devstack sudo[94749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD
Sep 08 16:36:31 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:31 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:31 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 is fetched for user 3ef9a73bff2d407c88d018c36ff05bbf. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bd8d62-b2f1-4a8a-9d64-b11ae80f6843]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:32 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD
Sep 08 16:36:32 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:32 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1873310048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45d0039c-05e0-4af3-b215-5f438c49ac57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ea13c074bf14ba7aefb7ad890c3a28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:31Z,use_quota=True,user_id='3ef9a73bff2d407c88d018c36ff05bbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Creating volume 45d0039c-05e0-4af3-b215-5f438c49ac57 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:32 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:32 devstack sudo[94759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 1073741824
Sep 08 16:36:32 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "cinder-59b42f4c-87e0-4843-ad54-67b4ca4940d1-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-59b42f4c-87e0-4843-ad54-67b4ca4940d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "cinder-quobyte-59b42f4c-87e0-4843-ad54-67b4ca4940d1" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-quobyte-59b42f4c-87e0-4843-ad54-67b4ca4940d1" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[255d4201-6cd1-4681-8b50-4590de6f4a13]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:32 devstack sudo[94761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1
Sep 08 16:36:32 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:32 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 1073741824" returned: 0 in 0.467s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:32 devstack sudo[94768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57
Sep 08 16:36:32 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:33 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1" returned: 0 in 0.434s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:33 devstack sudo[94773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1
Sep 08 16:36:33 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:33 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Attempting download of 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume 45d0039c-05e0-4af3-b215-5f438c49ac57. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2294a30-47d1-4da1-b9a6-04390a54ce3a]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_sfe0b6gn {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:33 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-59b42f4c-87e0-4843-ad54-67b4ca4940d1" returned: 0 in 0.279s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-quobyte-59b42f4c-87e0-4843-ad54-67b4ca4940d1" released by "delete_volume" :: held 0.763s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Created reservations ['b13a4927-d539-4de7-bfcd-e450a4869986', 'de96ddb3-06b8-4181-b824-19de0974e364', '6dcd8bb5-901d-4b9b-a329-e766e2be6142', 'b6df443f-cd88-46d6-b485-d507722f6963'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:33 devstack sudo[94777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_sfe0b6gn
Sep 08 16:36:33 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:33 devstack sudo[94779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:33 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "cinder-45eda9a1-0e78-4c1a-83e7-9f566713ad4b-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:33 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-45eda9a1-0e78-4c1a-83e7-9f566713ad4b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_sfe0b6gn" returned: 0 in 0.427s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_sfe0b6gn {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:33 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.308s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:33 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Deleted volume successfully.
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "cinder-quobyte-45eda9a1-0e78-4c1a-83e7-9f566713ad4b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df8a0951-1b97-4457-8619-37d2a2ccc012 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-59b42f4c-87e0-4843-ad54-67b4ca4940d1-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-quobyte-45eda9a1-0e78-4c1a-83e7-9f566713ad4b" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8261744-6dcc-4b09-9805-1666cf64a5eb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:33 devstack sudo[94784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_sfe0b6gn
Sep 08 16:36:33 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:34 devstack sudo[94785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b
Sep 08 16:36:34 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:34 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_sfe0b6gn" returned: 1 in 0.387s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_sfe0b6gn' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f583700-9032-400c-bf93-c548af92ca24]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:34 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD
Sep 08 16:36:34 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:34 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b" returned: 0 in 0.392s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:34 devstack sudo[94795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b
Sep 08 16:36:34 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:34 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] 9bf04763-a04a-46d0-817b-b7085cff6448 was qcow2, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:34 devstack sudo[94801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57
Sep 08 16:36:34 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:34 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45eda9a1-0e78-4c1a-83e7-9f566713ad4b" returned: 0 in 0.274s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-quobyte-45eda9a1-0e78-4c1a-83e7-9f566713ad4b" released by "delete_volume" :: held 0.714s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Created reservations ['b7430440-fedc-4f1c-b367-a4e253377469', '1b488c42-e6f0-49d7-bec5-d7a6b7cbc106', '910dffed-ab8c-46e7-8370-0f6aedbca3bc', 'b289e35a-1298-4500-80c5-866012f74687'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:34 devstack sudo[94803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:34 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:35 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.347s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Deleted volume successfully.
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "cinder-3af5999e-a453-453d-92e1-8c6c1abdc47f-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a1ed3a80-67d9-4303-b752-4c732ab9eac7 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-45eda9a1-0e78-4c1a-83e7-9f566713ad4b-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-3af5999e-a453-453d-92e1-8c6c1abdc47f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "cinder-quobyte-3af5999e-a453-453d-92e1-8c6c1abdc47f" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-quobyte-3af5999e-a453-453d-92e1-8c6c1abdc47f" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019cdf6-e77b-4752-9f61-3c4f3c507f22]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:35 devstack sudo[94818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f
Sep 08 16:36:35 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:35 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f" returned: 0 in 0.480s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:35 devstack sudo[94823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f
Sep 08 16:36:35 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:36 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3af5999e-a453-453d-92e1-8c6c1abdc47f" returned: 0 in 0.371s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-quobyte-3af5999e-a453-453d-92e1-8c6c1abdc47f" released by "delete_volume" :: held 0.919s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Created reservations ['29e6becb-96e9-4bcb-af9d-72b4f0a95d66', 'efdc9191-cd22-4a9d-bcae-a5425b66151f', '2180d057-ab9e-4a3b-a0b7-2d231e412a0f', '190026ea-2f02-4bcf-8014-bb0d7ca7259b'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:36 devstack sudo[94826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:36 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:36 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.317s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Deleted volume successfully.
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09961b9b-2680-42c8-b65a-1843670803f4 tempest-AttachVolumeTestJSON-179529324 None] Lock "cinder-3af5999e-a453-453d-92e1-8c6c1abdc47f-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:36 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57" returned: 0 in 2.302s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_oe1d8a4ndevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:36:36 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Converted 112.00 MB image at 48.64 MB/s
Sep 08 16:36:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:36 devstack sudo[94829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 1G
Sep 08 16:36:36 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:37 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 1G" returned: 0 in 0.317s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Downloaded image 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume 45d0039c-05e0-4af3-b215-5f438c49ac57 successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 for user 3ef9a73bff2d407c88d018c36ff05bbf is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Marking volume 45d0039c-05e0-4af3-b215-5f438c49ac57 as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Copying metadata from image 9bf04763-a04a-46d0-817b-b7085cff6448 to 45d0039c-05e0-4af3-b215-5f438c49ac57. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Creating volume glance metadata for volume 45d0039c-05e0-4af3-b215-5f438c49ac57 backed by image 9bf04763-a04a-46d0-817b-b7085cff6448 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f90d3a-639f-42b6-8f30-a04a064bf10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45d0039c-05e0-4af3-b215-5f438c49ac57', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440877e60>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5f4069-87ad-412a-bae6-978dab9f491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:37 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Volume volume-45d0039c-05e0-4af3-b215-5f438c49ac57 (45d0039c-05e0-4af3-b215-5f438c49ac57): created successfully
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c5f4069-87ad-412a-bae6-978dab9f491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Flow 'volume_create_manager' (501bcf8f-8cec-4a44-9360-f57284571045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-764c9fc4-244b-4e83-91cc-09dad27eb670 tempest-VolumesImageMetadata-753950841 None] Created volume successfully.
Sep 08 16:36:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Acquiring lock "cinder-45d0039c-05e0-4af3-b215-5f438c49ac57-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Lock "cinder-45d0039c-05e0-4af3-b215-5f438c49ac57-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Acquiring lock "cinder-quobyte-45d0039c-05e0-4af3-b215-5f438c49ac57" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Lock "cinder-quobyte-45d0039c-05e0-4af3-b215-5f438c49ac57" acquired by "delete_volume" :: waited 0.042s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9556b-16d0-4ce2-85a0-0eee9b4da4ad]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:39 devstack sudo[94858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57
Sep 08 16:36:39 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:39 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57" returned: 0 in 0.461s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:39 devstack sudo[94865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57
Sep 08 16:36:39 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Flow 'volume_create_manager' (a329a216-2f5c-4d02-8ed9-04984a0dd1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9828f454-e45a-46e2-8622-691acacfec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9828f454-e45a-46e2-8622-691acacfec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1775109605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0defd7fc-bfa8-43ab-901a-4a782c996e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae115161a8284899b0daa5c490dc1d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:40Z,use_quota=True,user_id='f06147fa2e5648b6adb27ea760c13e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847b776-57c9-4a9b-a068-56d7d3adb5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e847b776-57c9-4a9b-a068-56d7d3adb5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47ffe75-e36e-4461-874d-308d32ed0cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47ffe75-e36e-4461-874d-308d32ed0cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0defd7fc-bfa8-43ab-901a-4a782c996e6b', 'volume_name': 'volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eb4cdf-e1ec-445a-89ab-f8da1abb2dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eb4cdf-e1ec-445a-89ab-f8da1abb2dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08208fc7-09c9-4f6d-a327-c4d00a298249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:39 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Volume 0defd7fc-bfa8-43ab-901a-4a782c996e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b', 'volume_size': 1}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1775109605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0defd7fc-bfa8-43ab-901a-4a782c996e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae115161a8284899b0daa5c490dc1d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:40Z,use_quota=True,user_id='f06147fa2e5648b6adb27ea760c13e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Creating volume 0defd7fc-bfa8-43ab-901a-4a782c996e6b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:39 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:39 devstack sudo[94867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b 1073741824
Sep 08 16:36:39 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:40 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-45d0039c-05e0-4af3-b215-5f438c49ac57" returned: 0 in 0.350s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Lock "cinder-quobyte-45d0039c-05e0-4af3-b215-5f438c49ac57" released by "delete_volume" :: held 0.895s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Created reservations ['1cc2604f-0d0d-4ee1-aad8-55e0e493dbb5', 'afaf105b-1524-4ea0-b298-639a1f8be1ff', 'db5e2092-b319-4f0b-9b0c-221584500eae', '8cb94345-00bb-4229-8fa5-c62a351caf4f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:40 devstack sudo[94872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:40 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:40 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.283s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Deleted volume successfully.
Sep 08 16:36:40 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b 1073741824" returned: 0 in 0.641s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e8514c82-ac93-4ac8-adc5-7c203bca7f0b tempest-VolumesImageMetadata-753950841 None] Lock "cinder-45d0039c-05e0-4af3-b215-5f438c49ac57-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:40 devstack sudo[94878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b
Sep 08 16:36:40 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:40 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b" returned: 0 in 0.256s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08208fc7-09c9-4f6d-a327-c4d00a298249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d59583-2ae3-47f0-a675-4a606653bd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:40 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Volume volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b (0defd7fc-bfa8-43ab-901a-4a782c996e6b): created successfully
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d59583-2ae3-47f0-a675-4a606653bd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Flow 'volume_create_manager' (a329a216-2f5c-4d02-8ed9-04984a0dd1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7db8376a-0b95-4b98-b95d-fa534aa2540a tempest-VolumeQuotasNegativeTestJSON-841290301 None] Created volume successfully.
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Acquiring lock "cinder-0defd7fc-bfa8-43ab-901a-4a782c996e6b-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "cinder-0defd7fc-bfa8-43ab-901a-4a782c996e6b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Acquiring lock "cinder-quobyte-0defd7fc-bfa8-43ab-901a-4a782c996e6b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "cinder-quobyte-0defd7fc-bfa8-43ab-901a-4a782c996e6b" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d651cb6-fdde-495a-819a-7a0b1258596d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:43 devstack sudo[94885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b
Sep 08 16:36:43 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:43 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b" returned: 0 in 0.458s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:43 devstack sudo[94891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b
Sep 08 16:36:43 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:44 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0defd7fc-bfa8-43ab-901a-4a782c996e6b" returned: 0 in 0.334s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "cinder-quobyte-0defd7fc-bfa8-43ab-901a-4a782c996e6b" released by "delete_volume" :: held 0.860s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Created reservations ['11883678-d8f4-42c7-b952-1154086dd367', '655aba61-d1f3-4224-8552-18212257b865', '7c80f79f-7f96-48cc-a997-8cd707a854ba', '4c1e7e1d-fd5d-4cc8-92d1-3bae9386adf5'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:44 devstack sudo[94894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:44 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Acquiring lock "cinder-dd057622-4101-4603-8fd6-51fd3dcafbf1-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "cinder-dd057622-4101-4603-8fd6-51fd3dcafbf1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Acquiring lock "cinder-quobyte-dd057622-4101-4603-8fd6-51fd3dcafbf1" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "cinder-quobyte-dd057622-4101-4603-8fd6-51fd3dcafbf1" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea860bbd-2af6-4ef8-8388-98d15586727b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:44 devstack sudo[94896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1
Sep 08 16:36:44 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.449s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:44 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:44 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Deleted volume successfully.
Sep 08 16:36:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5607978b-34bc-42b3-b04b-dcdf7a3308c9 tempest-VolumeQuotasNegativeTestJSON-841290301 None] Lock "cinder-0defd7fc-bfa8-43ab-901a-4a782c996e6b-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:45 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:45 devstack sudo[94902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1
Sep 08 16:36:45 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:45 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd057622-4101-4603-8fd6-51fd3dcafbf1" returned: 0 in 0.266s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "cinder-quobyte-dd057622-4101-4603-8fd6-51fd3dcafbf1" released by "delete_volume" :: held 0.766s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Created reservations ['08adca6c-96e8-4067-af14-63ceb65df31b', '969547e9-0255-4037-963d-6e19b7872632', '0106f25a-d5a8-43ec-81fe-ecfddba02ca8', '7ff4d9da-d85d-4c21-b7d9-de91c6ad4817'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:45 devstack sudo[94905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:45 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:45 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.279s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:45 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Deleted volume successfully.
Sep 08 16:36:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85b2b3ea-603c-4fcb-af9d-5a0904e3b4cd tempest-AttachVolumeShelveTestJSON-531892175 None] Lock "cinder-dd057622-4101-4603-8fd6-51fd3dcafbf1-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Flow 'volume_create_manager' (9a12dfd9-050d-4ced-b116-8d2ca4beb52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b799d9e-3577-4966-b50d-3113a244a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b799d9e-3577-4966-b50d-3113a244a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-307146339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4941c146-6ab5-4519-ac02-9af096546b10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43a59b6bbe2d49f5bb33e967a80cd375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:49Z,use_quota=True,user_id='b4d6fc90055d4c509c590baf483bf353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9ede1a-d140-47b5-9b1e-7106587e7b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9ede1a-d140-47b5-9b1e-7106587e7b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09540318-4770-462d-8e63-af8a85ba1b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09540318-4770-462d-8e63-af8a85ba1b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4941c146-6ab5-4519-ac02-9af096546b10', 'volume_name': 'volume-4941c146-6ab5-4519-ac02-9af096546b10', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2af299-091e-4539-8e3d-f7d3ba777f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2af299-091e-4539-8e3d-f7d3ba777f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9a11a0-65f9-4e56-bc28-2257e4780120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Volume 4941c146-6ab5-4519-ac02-9af096546b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4941c146-6ab5-4519-ac02-9af096546b10', 'volume_size': 1}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-307146339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4941c146-6ab5-4519-ac02-9af096546b10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43a59b6bbe2d49f5bb33e967a80cd375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:49Z,use_quota=True,user_id='b4d6fc90055d4c509c590baf483bf353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Creating volume 4941c146-6ab5-4519-ac02-9af096546b10 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:48 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:48 devstack sudo[94909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10 1073741824
Sep 08 16:36:48 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:49 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10 1073741824" returned: 0 in 0.583s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:49 devstack sudo[94951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10
Sep 08 16:36:49 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:49 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10" returned: 0 in 0.401s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9a11a0-65f9-4e56-bc28-2257e4780120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4941c146-6ab5-4519-ac02-9af096546b10', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfdd0a6-b73c-49c7-9b73-6e45601a6aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Volume volume-4941c146-6ab5-4519-ac02-9af096546b10 (4941c146-6ab5-4519-ac02-9af096546b10): created successfully
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cfdd0a6-b73c-49c7-9b73-6e45601a6aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Flow 'volume_create_manager' (9a12dfd9-050d-4ced-b116-8d2ca4beb52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-f4121e15-f411-4e82-a3b3-8605487c6927 req-5efe1ac0-57b3-499b-a905-a205e00e1252 tempest-VolumesGetTestJSON-1837267696 None] Created volume successfully.
Sep 08 16:36:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Acquiring lock "cinder-4941c146-6ab5-4519-ac02-9af096546b10-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Lock "cinder-4941c146-6ab5-4519-ac02-9af096546b10-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Acquiring lock "cinder-quobyte-4941c146-6ab5-4519-ac02-9af096546b10" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Lock "cinder-quobyte-4941c146-6ab5-4519-ac02-9af096546b10" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:51 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c1c836-bbb1-4390-9a5d-ed18a31b6490]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:51 devstack sudo[94955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10
Sep 08 16:36:51 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:52 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10" returned: 0 in 0.453s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:52 devstack sudo[94960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10
Sep 08 16:36:52 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4941c146-6ab5-4519-ac02-9af096546b10" returned: 0 in 0.338s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:52 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Lock "cinder-quobyte-4941c146-6ab5-4519-ac02-9af096546b10" released by "delete_volume" :: held 0.843s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.quota [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Created reservations ['31a53b01-9551-4679-a007-c486deefbcf2', 'd7e76b0d-1eab-40d2-932b-6df72bf2e471', '09c1517d-e455-49bb-a83c-fe5d4a0af8f8', '52570811-e56f-4301-84df-85f4b7702407'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Flow 'volume_create_manager' (acb0925a-7709-4556-ae6a-ef2bd8d96843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b09d17-63c9-4c96-a509-a30b97f1ef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b09d17-63c9-4c96-a509-a30b97f1ef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1450648489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879aec15fd8448409a517e2c0c4e4279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:52Z,use_quota=True,user_id='975e8ac0fdd647289ff9f9a03b867748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2acce09-69cc-4c60-968f-5543562c0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2acce09-69cc-4c60-968f-5543562c0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace758ec-bac8-43ed-ad57-b306aa79f4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace758ec-bac8-43ed-ad57-b306aa79f4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29', 'volume_name': 'volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a861dabf-4c0b-4d83-8119-bdc3ab847ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a861dabf-4c0b-4d83-8119-bdc3ab847ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10080f90-5122-4f20-aa03-ec7bcfc8e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Volume f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29', 'volume_size': 1}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1450648489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879aec15fd8448409a517e2c0c4e4279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:52Z,use_quota=True,user_id='975e8ac0fdd647289ff9f9a03b867748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Creating volume f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:36:52 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:52 devstack sudo[94963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 1073741824
Sep 08 16:36:52 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:52 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:52 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:52 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.291s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:52 devstack cinder-volume[87505]: DEBUG cinder.manager [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Deleted volume successfully.
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-aeeb6c87-454e-4ad6-ad21-5571fad76916 req-b9afdfa2-a1e6-4d19-9d82-11406a8065d2 tempest-VolumesGetTestJSON-1837267696 None] Lock "cinder-4941c146-6ab5-4519-ac02-9af096546b10-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:36:53 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 1073741824" returned: 0 in 0.545s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:53 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29
Sep 08 16:36:53 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:53 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10080f90-5122-4f20-aa03-ec7bcfc8e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9454544c-7f4d-4a89-a372-2cbe975bfafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Volume volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 (f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29): created successfully
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9454544c-7f4d-4a89-a372-2cbe975bfafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Flow 'volume_create_manager' (acb0925a-7709-4556-ae6a-ef2bd8d96843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a00c389e-9c00-4371-8bd9-de30ab242784 tempest-VolumesCloneTest-1746701924 None] Created volume successfully.
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Flow 'volume_create_manager' (72f9b241-e9bf-4a54-af88-32c3ba8b49ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf89052c-a29c-46ec-997a-7d713bba4c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf89052c-a29c-46ec-997a-7d713bba4c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1607057051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77c3a46-5023-4e69-86fb-4c08a5bd8ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='879aec15fd8448409a517e2c0c4e4279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:36:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29,status='creating',terminated_at=None,updated_at=2026-09-08T14:36:55Z,use_quota=True,user_id='975e8ac0fdd647289ff9f9a03b867748',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd81711-f96b-4230-a35b-a633a284b134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd81711-f96b-4230-a35b-a633a284b134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2828b5b9-d69c-43d8-bbec-d557de5d3a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2828b5b9-d69c-43d8-bbec-d557de5d3a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f77c3a46-5023-4e69-86fb-4c08a5bd8ca8', 'volume_name': 'volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8', 'volume_size': 2, 'source_volid': 'f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29', 'source_volstatus': 'available'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51980ffa-6370-4eb1-bac7-c077af4e47ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51980ffa-6370-4eb1-bac7-c077af4e47ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af72575b-da3c-4f10-b289-ab6e86c80109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:36:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Volume f77c3a46-5023-4e69-86fb-4c08a5bd8ca8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8', 'volume_size': 2, 'source_volid': 'f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29', 'source_volstatus': 'available'}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:55 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Cloning volume f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 to volume f77c3a46-5023-4e69-86fb-4c08a5bd8ca8
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Creating offline snapshot 9b8689bd-a38d-4bc8-8130-20cd6f63624a of volume f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[389c1afd-0824-4ba5-a8d1-16cc5d855c12]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:55 devstack sudo[94977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29
Sep 08 16:36:55 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:55 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" returned: 0 in 0.463s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:55 devstack sudo[94982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a 1G
Sep 08 16:36:55 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:56 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a 1G" returned: 0 in 0.589s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:56 devstack sudo[94989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a
Sep 08 16:36:56 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:56 devstack sudo[94991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:36:56 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:56 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a" returned: 0 in 0.401s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:56 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a is being set with open permissions: ugo+rw
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:56 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.373s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:36:56 devstack sudo[94997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:36:56 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:36:57 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a" returned: 0 in 0.343s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:57 devstack sudo[95000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.info
Sep 08 16:36:57 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:57 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.info" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:57 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.info is being set with open permissions: ugo+rw
Sep 08 16:36:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:57 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.info
Sep 08 16:36:57 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:57 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.info" returned: 0 in 0.313s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "cinder-quobyte-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] snapshot: 9b8689bd-a38d-4bc8-8130-20cd6f63624a, volume: f77c3a46-5023-4e69-86fb-4c08a5bd8ca8,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[099c67c4-302f-468e-932b-8eddde305429]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:58 devstack sudo[95006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a
Sep 08 16:36:58 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:58 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a" returned: 0 in 0.487s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40d50bd-964b-4bb1-8116-33fa4f99f87a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:36:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:58 devstack sudo[95012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29
Sep 08 16:36:58 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:36:59 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root
Sep 08 16:36:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" returned: 0 in 0.519s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:36:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:36:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:36:59 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:36:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:36:59 devstack sudo[95018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8
Sep 08 16:36:59 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:05 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" returned: 0 in 6.353s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:37:05 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Converted 1024.00 MB image at 161.12 MB/s
Sep 08 16:37:05 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 is being set with open permissions: ugo+rw
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:05 devstack sudo[95033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8
Sep 08 16:37:05 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:05 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" returned: 0 in 0.326s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" released by "_copy_volume_from_snapshot" :: held 7.793s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "cinder-quobyte-9b8689bd-a38d-4bc8-8130-20cd6f63624a" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-9b8689bd-a38d-4bc8-8130-20cd6f63624a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Deleting offline snapshot 9b8689bd-a38d-4bc8-8130-20cd6f63624a of volume f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] snapshot_file for this snap is: volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ffbe13-32e3-499a-bebc-19516bf18c18]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:05 devstack sudo[95036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a
Sep 08 16:37:05 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:06 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a" returned: 0 in 0.381s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:06 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac724bdf-d123-40ee-a77f-89771c94b6a2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:06 devstack sudo[95042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29
Sep 08 16:37:06 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:06 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" returned: 0 in 0.580s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:06 devstack sudo[95047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a
Sep 08 16:37:06 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:07 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a" returned: 0 in 0.426s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:07 devstack sudo[95058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a
Sep 08 16:37:07 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=47,cinder:INSERT=24,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:37:07 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29.9b8689bd-a38d-4bc8-8130-20cd6f63624a" returned: 0 in 0.305s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-9b8689bd-a38d-4bc8-8130-20cd6f63624a" released by "_delete_snapshot" :: held 1.800s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.251s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af72575b-da3c-4f10-b289-ab6e86c80109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8', 'volume_size': 2, 'source_volid': 'f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29', 'source_volstatus': 'available'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16703363-b7f6-4c27-8c90-f9cb2ad4a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Volume volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 (f77c3a46-5023-4e69-86fb-4c08a5bd8ca8): created successfully
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16703363-b7f6-4c27-8c90-f9cb2ad4a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Flow 'volume_create_manager' (72f9b241-e9bf-4a54-af88-32c3ba8b49ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-02bc0e30-7b50-4ced-861e-a2a369631c41 tempest-VolumesCloneTest-1746701924 None] Created volume successfully.
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Acquiring lock "cinder-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Lock "cinder-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Acquiring lock "cinder-quobyte-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" acquired by "delete_volume" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b63e5b-9691-4d4a-96ec-46cb716eb1f6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:09 devstack sudo[95061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8
Sep 08 16:37:09 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:09 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" returned: 0 in 0.385s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:09 devstack sudo[95066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8
Sep 08 16:37:09 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:10 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" returned: 0 in 0.360s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8" released by "delete_volume" :: held 0.807s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Created reservations ['acc172db-e3fc-47a9-88a0-c82b0244f3ce', '31c6ff93-ba2c-4a44-ab7d-2009bafea529', '333ce452-6fa2-4f72-a990-84da3c28632a', 'b0eb7916-d7bb-4486-847f-0238e2e74955'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:10 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:10 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "cinder-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "cinder-quobyte-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[654c0725-8dd3-4b94-bcb8-55b856f8aaf5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:10 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29
Sep 08 16:37:10 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:10 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.465s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Deleted volume successfully.
Sep 08 16:37:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-702ea6a2-73f5-4892-ba2f-51c11ba2633a tempest-VolumesCloneTest-1746701924 None] Lock "cinder-f77c3a46-5023-4e69-86fb-4c08a5bd8ca8-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:11 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" returned: 0 in 0.424s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:11 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29
Sep 08 16:37:11 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:11 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" returned: 0 in 0.314s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-quobyte-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29" released by "delete_volume" :: held 0.821s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Created reservations ['54993184-d82f-4db3-a4ba-e0a0516eb01f', 'e4f8d4ce-8939-4793-b6ec-3e7c778ae6ee', '3b11b827-d2a7-46da-9bf4-43b60699389e', 'f5dbaebe-81d4-44a1-8186-6c1350c5ba34'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:11 devstack sudo[95081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:11 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:11 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.322s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:11 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Deleted volume successfully.
Sep 08 16:37:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cfc0c9b-6b75-451e-bf58-c94a3552d8c1 tempest-VolumesCloneTest-1746701924 None] Lock "cinder-f19bc53f-7a9d-4dac-b9fb-2c7bbed15f29-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Flow 'volume_create_manager' (a5d91ece-b498-4f5b-981c-ebe7674d6b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2864f9d-96ad-4eb7-b03d-68f04e4e5ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2864f9d-96ad-4eb7-b03d-68f04e4e5ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1349101758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bc8c73-3e07-41ab-a9de-ed669339b2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a4a81350e457699233a952a098bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:13Z,use_quota=True,user_id='b62c0b6e021a4d57b7b8566504a66b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804322f4-a670-475d-8418-7924c86e0a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804322f4-a670-475d-8418-7924c86e0a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d520a46-ff2d-4c4c-98e1-f01554222bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d520a46-ff2d-4c4c-98e1-f01554222bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7bc8c73-3e07-41ab-a9de-ed669339b2b0', 'volume_name': 'volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7898a2c5-362b-4533-bcda-f3b7e87d0a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7898a2c5-362b-4533-bcda-f3b7e87d0a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7f9fd7-8371-4ae8-81b7-d6cc8da6fcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:12 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Volume c7bc8c73-3e07-41ab-a9de-ed669339b2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0', 'volume_size': 1}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1349101758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bc8c73-3e07-41ab-a9de-ed669339b2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad8a4a81350e457699233a952a098bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:13Z,use_quota=True,user_id='b62c0b6e021a4d57b7b8566504a66b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Creating volume c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:12 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:12 devstack sudo[95084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 1073741824
Sep 08 16:37:12 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:13 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 1073741824" returned: 0 in 0.548s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=105,cinder:UPDATE=138,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:13 devstack sudo[95091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0
Sep 08 16:37:13 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:13 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" returned: 0 in 0.298s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7f9fd7-8371-4ae8-81b7-d6cc8da6fcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29703b82-c78e-4c57-bccd-5454bf69badd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:13 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Volume volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 (c7bc8c73-3e07-41ab-a9de-ed669339b2b0): created successfully
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29703b82-c78e-4c57-bccd-5454bf69badd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Flow 'volume_create_manager' (a5d91ece-b498-4f5b-981c-ebe7674d6b6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:13 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9b93972c-0d49-48c6-a31e-602b82629b6b tempest-SnapshotMetadataTestJSON-739108140 None] Created volume successfully.
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Flow 'volume_create_manager' (9e9975ef-19be-4af3-bb78-34829b0f027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1468a0c9-e705-40f2-8f2f-bf0ffeb04d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1468a0c9-e705-40f2-8f2f-bf0ffeb04d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1888513009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f7b85e-ab24-426e-9650-2c337de5bb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3192815f096640a7ab6158eb6afaec42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:14Z,use_quota=True,user_id='12499acb419c4796aacb9d93e869f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308388ce-8637-4f2d-8303-1e4656d2dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308388ce-8637-4f2d-8303-1e4656d2dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6b9e2f-59eb-4b38-8374-bcb00a26cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6b9e2f-59eb-4b38-8374-bcb00a26cc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f7b85e-ab24-426e-9650-2c337de5bb70', 'volume_name': 'volume-04f7b85e-ab24-426e-9650-2c337de5bb70', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860acebb-32e4-4de4-9790-1817a1e5e257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860acebb-32e4-4de4-9790-1817a1e5e257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d159b-47f6-407c-8592-8b3787033c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Volume 04f7b85e-ab24-426e-9650-2c337de5bb70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f7b85e-ab24-426e-9650-2c337de5bb70', 'volume_size': 1}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1888513009',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f7b85e-ab24-426e-9650-2c337de5bb70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3192815f096640a7ab6158eb6afaec42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:14Z,use_quota=True,user_id='12499acb419c4796aacb9d93e869f657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Creating volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:14 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:14 devstack sudo[95097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 1073741824
Sep 08 16:37:14 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:14 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 1073741824" returned: 0 in 0.506s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:14 devstack sudo[95103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70
Sep 08 16:37:14 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:14 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70" returned: 0 in 0.354s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c6d159b-47f6-407c-8592-8b3787033c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f7b85e-ab24-426e-9650-2c337de5bb70', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c75817-f5b4-4727-8132-2f9727b1f0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Volume volume-04f7b85e-ab24-426e-9650-2c337de5bb70 (04f7b85e-ab24-426e-9650-2c337de5bb70): created successfully
Sep 08 16:37:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c75817-f5b4-4727-8132-2f9727b1f0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Flow 'volume_create_manager' (9e9975ef-19be-4af3-bb78-34829b0f027c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5f6c7e1e-96a0-4284-8353-5badf94e4bbd tempest-SnapshotsActionsTest-1034072052 None] Created volume successfully.
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Creating offline snapshot 627d0ddc-5211-43da-8728-33679b0e764b of volume c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1150f-a274-4cad-a445-8b8f6c53d8b3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:15 devstack sudo[95106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0
Sep 08 16:37:15 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:15 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" returned: 0 in 0.442s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:15 devstack sudo[95111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b 1G
Sep 08 16:37:15 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:16 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b 1G" returned: 0 in 0.557s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:16 devstack sudo[95126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b
Sep 08 16:37:16 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:16 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b" returned: 0 in 0.509s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:16 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b is being set with open permissions: ugo+rw
Sep 08 16:37:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:16 devstack sudo[95137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b
Sep 08 16:37:16 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:16 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:16 devstack sudo[95140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.info
Sep 08 16:37:16 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (6df1856d-7d46-4d20-9e71-29318bf3fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce59bebd-7730-48fd-8553-2dc022a29657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce59bebd-7730-48fd-8553-2dc022a29657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1806111962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebc4b0e-3c7d-4382-9497-661f4fc75457,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:17Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd47d6c-3147-45e7-b63a-887cf0255b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd47d6c-3147-45e7-b63a-887cf0255b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775f062f-e05b-409b-ab8a-53d0648a1373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775f062f-e05b-409b-ab8a-53d0648a1373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ebc4b0e-3c7d-4382-9497-661f4fc75457', 'volume_name': 'volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27f0012-d879-47b3-9757-5b1b6044b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27f0012-d879-47b3-9757-5b1b6044b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18d9ad1-4374-454b-86cd-653dd193e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:17 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Volume 3ebc4b0e-3c7d-4382-9497-661f4fc75457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457', 'volume_size': 1}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:17 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.info" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:17 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.info is being set with open permissions: ugo+rw
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:17 devstack sudo[95143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.info
Sep 08 16:37:17 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:17 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.info" returned: 0 in 0.258s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.432s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.184s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Creating offline snapshot e85c98c6-6786-46ea-b5c6-c487ce705d5c of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-50384111-d610-471e-90a4-7f7dbea04cac tempest-SnapshotMetadataTestJSON-739108140 None] Create snapshot completed successfully
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b9065-d682-47c3-a367-52f501d799e1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:17 devstack sudo[95146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70
Sep 08 16:37:17 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:17 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70" returned: 0 in 0.383s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:17 devstack sudo[95152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c 1G
Sep 08 16:37:17 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:18 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c 1G" returned: 0 in 0.527s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:18 devstack sudo[95163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:18 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:19 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.660s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:19 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c is being set with open permissions: ugo+rw
Sep 08 16:37:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:19 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:19 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:19 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.476s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:19 devstack sudo[95232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.info
Sep 08 16:37:19 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:19 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.info" returned: 0 in 0.304s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:19 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.info is being set with open permissions: ugo+rw
Sep 08 16:37:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:19 devstack sudo[95236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.info
Sep 08 16:37:19 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "cinder-627d0ddc-5211-43da-8728-33679b0e764b-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-627d0ddc-5211-43da-8728-33679b0e764b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "cinder-quobyte-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-quobyte-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "cinder-quobyte-627d0ddc-5211-43da-8728-33679b0e764b" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-quobyte-627d0ddc-5211-43da-8728-33679b0e764b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Deleting offline snapshot 627d0ddc-5211-43da-8728-33679b0e764b of volume c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] snapshot_file for this snap is: volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad58596-9547-40ec-9fde-571405b70b75]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:20 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.info" returned: 0 in 0.340s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.182s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1806111962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ebc4b0e-3c7d-4382-9497-661f4fc75457,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:17Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Creating volume 3ebc4b0e-3c7d-4382-9497-661f4fc75457 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:20 devstack sudo[95240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:20 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:20 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:20 devstack sudo[95243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457 1073741824
Sep 08 16:37:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-04d4f339-19b4-46ff-a29e-c25d3382d220 tempest-SnapshotsActionsTest-1034072052 None] Create snapshot completed successfully
Sep 08 16:37:20 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:20 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b" returned: 0 in 0.640s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f9d425-fa28-4acc-92a5-acd2ab1a609b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:20 devstack sudo[95251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0
Sep 08 16:37:20 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:21 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457 1073741824" returned: 0 in 0.837s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:21 devstack sudo[95254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457
Sep 08 16:37:21 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:21 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" returned: 0 in 0.615s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:21 devstack sudo[95260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b
Sep 08 16:37:21 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:21 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457" returned: 0 in 0.362s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.096s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18d9ad1-4374-454b-86cd-653dd193e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b002374-0c79-4a3b-9da1-d34bbd64e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Creating offline snapshot a8e8ffe8-f799-41ff-b487-e1373dfd236a of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Volume volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457 (3ebc4b0e-3c7d-4382-9497-661f4fc75457): created successfully
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b002374-0c79-4a3b-9da1-d34bbd64e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (6df1856d-7d46-4d20-9e71-29318bf3fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3143968-0e29-478a-82fd-cf9cc83d3337]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b0c6b3ce-fc0a-47c2-9b2f-0a0ca024352e tempest-VolumesGetTest-1452743895 None] Created volume successfully.
Sep 08 16:37:21 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:21 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:21 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:21 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b
Sep 08 16:37:21 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:22 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0.627d0ddc-5211-43da-8728-33679b0e764b" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:22 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.471s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-quobyte-627d0ddc-5211-43da-8728-33679b0e764b" released by "_delete_snapshot" :: held 2.156s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-quobyte-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" released by "delete_snapshot" :: held 2.191s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:22 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a 1G
Sep 08 16:37:22 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:22 devstack cinder-volume[87505]: WARNING cinder.quota [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Created reservations ['770a124d-52ce-456c-a927-7200f29aa4bf', 'faeedcdb-9e73-4bad-83b2-7f4261a89823', 'c9e5c013-2283-4834-9d8b-b955ba7447e6', 'b4672809-0cb2-4a0c-ac4b-d163fdf15fa2'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Delete snapshot completed successfully.
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-839f1b66-2122-483a-b58e-86af4518f72d tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-627d0ddc-5211-43da-8728-33679b0e764b-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a 1G" returned: 0 in 0.600s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:22 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:22 devstack sudo[95282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a
Sep 08 16:37:22 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:23 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a" returned: 0 in 0.383s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:23 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a is being set with open permissions: ugo+rw
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:23 devstack sudo[95288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a
Sep 08 16:37:23 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "cinder-c7bc8c73-3e07-41ab-a9de-ed669339b2b0-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-c7bc8c73-3e07-41ab-a9de-ed669339b2b0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "cinder-quobyte-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-quobyte-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:23 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065bf07-184b-436e-9bc0-e9562797471f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a" returned: 0 in 0.574s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.227s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (c7711f25-e4a2-49de-8f4c-393ccef58a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263a9b35-527c-48ad-aa64-78721497ec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3d97b004-6a54-454e-95cc-f45e189657db tempest-SnapshotsActionsTest-1034072052 None] Create snapshot completed successfully
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (263a9b35-527c-48ad-aa64-78721497ec5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1306244003',display_name='tempest-VolumesGetTest-Volume-1198829373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82d034-e716-4071-8eb3-8b2b0fba2757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:24Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec9406c-1b57-4deb-b9d8-6e8329dd71ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:23 devstack sudo[95292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0
Sep 08 16:37:23 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec9406c-1b57-4deb-b9d8-6e8329dd71ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9a2494-e51e-407a-ac57-5c17d5999b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9a2494-e51e-407a-ac57-5c17d5999b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e82d034-e716-4071-8eb3-8b2b0fba2757', 'volume_name': 'volume-9e82d034-e716-4071-8eb3-8b2b0fba2757', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00e9a70-2401-4cd7-88ae-1799a92747f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00e9a70-2401-4cd7-88ae-1799a92747f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b8bbd5-8aaa-459a-beba-cf20655ea05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:23 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Volume 9e82d034-e716-4071-8eb3-8b2b0fba2757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e82d034-e716-4071-8eb3-8b2b0fba2757', 'volume_size': 1}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1306244003',display_name='tempest-VolumesGetTest-Volume-1198829373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e82d034-e716-4071-8eb3-8b2b0fba2757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:24Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Creating volume 9e82d034-e716-4071-8eb3-8b2b0fba2757 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:23 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:24 devstack sudo[95294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757 1073741824
Sep 08 16:37:24 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:24 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" returned: 0 in 0.508s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:24 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0
Sep 08 16:37:24 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:24 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757 1073741824" returned: 0 in 0.533s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:24 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" returned: 0 in 0.293s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-quobyte-c7bc8c73-3e07-41ab-a9de-ed669339b2b0" released by "delete_volume" :: held 0.902s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:24 devstack sudo[95308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757
Sep 08 16:37:24 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Created reservations ['20eadcc6-6a66-4526-94dc-ccb5c8861ea6', '4bc2f072-f829-43dc-99a3-391dc5e4410d', '46961792-1d29-4dc0-bec1-7ee5c6729d44', 'd5d518ac-3372-41ac-a5bf-b92fe441259b'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:24 devstack sudo[95310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:24 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-a8e8ffe8-f799-41ff-b487-e1373dfd236a-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-a8e8ffe8-f799-41ff-b487-e1373dfd236a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-a8e8ffe8-f799-41ff-b487-e1373dfd236a" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-a8e8ffe8-f799-41ff-b487-e1373dfd236a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:25 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Deleting offline snapshot a8e8ffe8-f799-41ff-b487-e1373dfd236a of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] snapshot_file for this snap is: volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757" returned: 0 in 0.462s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[775d7a58-6fd0-48ca-bef8-b34924a2555b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b8bbd5-8aaa-459a-beba-cf20655ea05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e82d034-e716-4071-8eb3-8b2b0fba2757', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dcb3c4-e5a4-421f-9dfe-8cc641c2cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:25 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Volume volume-9e82d034-e716-4071-8eb3-8b2b0fba2757 (9e82d034-e716-4071-8eb3-8b2b0fba2757): created successfully
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dcb3c4-e5a4-421f-9dfe-8cc641c2cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (c7711f25-e4a2-49de-8f4c-393ccef58a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a290ccf6-88ae-48bb-a2a6-71bd0cd2638f tempest-VolumesGetTest-1452743895 None] Created volume successfully.
Sep 08 16:37:25 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.324s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Deleted volume successfully.
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f78a1b6-5027-4eb5-a963-fe91b05d16fb tempest-SnapshotMetadataTestJSON-739108140 None] Lock "cinder-c7bc8c73-3e07-41ab-a9de-ed669339b2b0-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:25 devstack sudo[95313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a
Sep 08 16:37:25 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:25 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a" returned: 0 in 0.409s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a2697e-a9fa-4cdc-94db-89a51cdd5930]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:25 devstack sudo[95319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:25 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:25 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.418s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:25 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a
Sep 08 16:37:25 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-9e82d034-e716-4071-8eb3-8b2b0fba2757-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Lock "cinder-9e82d034-e716-4071-8eb3-8b2b0fba2757-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-9e82d034-e716-4071-8eb3-8b2b0fba2757" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-9e82d034-e716-4071-8eb3-8b2b0fba2757" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:26 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a" returned: 0 in 0.470s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a3ac4e-ca81-4db6-8d23-f0ee7753f05c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:26 devstack sudo[95331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a
Sep 08 16:37:26 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:26 devstack sudo[95332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757
Sep 08 16:37:26 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:26 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.a8e8ffe8-f799-41ff-b487-e1373dfd236a" returned: 0 in 0.296s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-a8e8ffe8-f799-41ff-b487-e1373dfd236a" released by "_delete_snapshot" :: held 1.690s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" released by "delete_snapshot" :: held 1.724s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:26 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757" returned: 0 in 0.411s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Created reservations ['4a5d5af1-84d1-44db-a85b-c04373c75821', '120a0467-5e47-4e7d-a5b0-c738b382b75d', '317f4fc7-a624-416c-bf21-47d49f93eb60', '7810f768-5a76-4304-8777-a79d7442947c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:26 devstack sudo[95339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757
Sep 08 16:37:26 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Delete snapshot completed successfully.
Sep 08 16:37:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-22cc7e60-e82d-47d5-b7a0-9a4b23da9800 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-a8e8ffe8-f799-41ff-b487-e1373dfd236a-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:27 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9e82d034-e716-4071-8eb3-8b2b0fba2757" returned: 0 in 0.296s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-9e82d034-e716-4071-8eb3-8b2b0fba2757" released by "delete_volume" :: held 0.755s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Created reservations ['ec995987-3a89-4891-817c-2ee3b8ef794c', '9b6162d4-6559-4731-b7e3-5c83122fc7c4', '76be730e-4c0a-489f-9a43-0bad6c930bbd', 'b7d03b12-0140-473e-8049-b8f8d1795011'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:27 devstack sudo[95342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:27 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-3ebc4b0e-3c7d-4382-9497-661f4fc75457-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Lock "cinder-3ebc4b0e-3c7d-4382-9497-661f4fc75457-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-3ebc4b0e-3c7d-4382-9497-661f4fc75457" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-3ebc4b0e-3c7d-4382-9497-661f4fc75457" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b43a6de-801b-4e2d-88b1-d1e25f002d7f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:27 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Creating offline snapshot 3ee9fa39-ce5f-45df-a7d2-de33267cceba of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.387s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Deleted volume successfully.
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[733e8b3c-2044-4f52-a126-52e45820d7e7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2229c947-cf2c-4ba8-b9b0-dddcd9e07f46 tempest-VolumesGetTest-1452743895 None] Lock "cinder-9e82d034-e716-4071-8eb3-8b2b0fba2757-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:28 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457
Sep 08 16:37:28 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:28 devstack sudo[95346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:28 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:28 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457" returned: 0 in 0.472s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:28 devstack sudo[95352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457
Sep 08 16:37:28 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:28 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.551s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:28 devstack sudo[95357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba 1G
Sep 08 16:37:28 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:28 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3ebc4b0e-3c7d-4382-9497-661f4fc75457" returned: 0 in 0.314s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-3ebc4b0e-3c7d-4382-9497-661f4fc75457" released by "delete_volume" :: held 0.850s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Created reservations ['84306cc2-cc13-47fd-93b1-b9495f1307ed', '8fbf1b02-32f3-40f9-bec7-92fd9cbb8c8c', '128d588f-7b7e-46fb-8689-2979478bd68c', 'c6b5e539-e5c1-4ae1-aeca-30c726609f9f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:28 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:28 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:29 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba 1G" returned: 0 in 0.540s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:29 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba
Sep 08 16:37:29 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:29 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.407s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Deleted volume successfully.
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fc6ae56b-3e22-49ec-8ba8-815424625ac2 tempest-VolumesGetTest-1452743895 None] Lock "cinder-3ebc4b0e-3c7d-4382-9497-661f4fc75457-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:29 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:29 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba is being set with open permissions: ugo+rw
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:29 devstack sudo[95374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba
Sep 08 16:37:29 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (ae95577c-075f-486e-895a-e0cdfed6c082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0824ea-11d7-4750-8940-6558888d86c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0824ea-11d7-4750-8940-6558888d86c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1310761377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14be8f36-30b5-4893-8a8f-cd44f345b4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:30Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91036e8-d60a-4248-bcb2-126448e5fef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91036e8-d60a-4248-bcb2-126448e5fef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44593322-0add-4ba3-b8e5-928baa6a4088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44593322-0add-4ba3-b8e5-928baa6a4088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14be8f36-30b5-4893-8a8f-cd44f345b4f3', 'volume_name': 'volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121588db-6f29-4f9e-968a-05aacbcbbe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121588db-6f29-4f9e-968a-05aacbcbbe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:29 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc42c02c-c4ac-4169-953c-013000b78289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:29 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Volume 14be8f36-30b5-4893-8a8f-cd44f345b4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3', 'volume_size': 1}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba" returned: 0 in 0.322s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1310761377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14be8f36-30b5-4893-8a8f-cd44f345b4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:30Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Creating volume 14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:29 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ef538f56-e5df-4b8a-8dc6-65f69862d7eb tempest-SnapshotsActionsTest-1034072052 None] Create snapshot completed successfully
Sep 08 16:37:29 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 1073741824
Sep 08 16:37:29 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:30 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 1073741824" returned: 0 in 0.497s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:30 devstack sudo[95383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3
Sep 08 16:37:30 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:30 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3" returned: 0 in 0.282s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc42c02c-c4ac-4169-953c-013000b78289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad535e8-5da6-464d-8be1-d4cd9fde417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:30 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Volume volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 (14be8f36-30b5-4893-8a8f-cd44f345b4f3): created successfully
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad535e8-5da6-464d-8be1-d4cd9fde417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (ae95577c-075f-486e-895a-e0cdfed6c082) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-00b57c17-ef7f-4038-bc39-8b78e38e2a2b tempest-VolumesGetTest-1452743895 None] Created volume successfully.
Sep 08 16:37:30 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Flow 'volume_create_manager' (954304f9-cb39-40a6-9cc1-f4d4c05cf9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79389a1e-202c-402d-8752-86dd563ef39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-3ee9fa39-ce5f-45df-a7d2-de33267cceba-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79389a1e-202c-402d-8752-86dd563ef39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1276006663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9281280-7084-439a-adfa-f028f0ed8479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf16a69e50145c0bfc9cb847cd610ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:31Z,use_quota=True,user_id='650984eb79f34554b17379bbec51aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd460ff5-8366-4234-bab0-3e87a5e8b9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd460ff5-8366-4234-bab0-3e87a5e8b9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fb1541-114c-4252-904b-05d8c2d5b149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fb1541-114c-4252-904b-05d8c2d5b149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9281280-7084-439a-adfa-f028f0ed8479', 'volume_name': 'volume-d9281280-7084-439a-adfa-f028f0ed8479', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c60ab7-1f26-4285-a27b-e93a9ab6302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c60ab7-1f26-4285-a27b-e93a9ab6302f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317a9fc5-174f-4e7f-8ace-0ebdcf31aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:31 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Volume d9281280-7084-439a-adfa-f028f0ed8479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9281280-7084-439a-adfa-f028f0ed8479', 'volume_size': 1}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1276006663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9281280-7084-439a-adfa-f028f0ed8479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf16a69e50145c0bfc9cb847cd610ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:31Z,use_quota=True,user_id='650984eb79f34554b17379bbec51aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Creating volume d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:31 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-3ee9fa39-ce5f-45df-a7d2-de33267cceba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:31 devstack sudo[95388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 1073741824
Sep 08 16:37:31 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-3ee9fa39-ce5f-45df-a7d2-de33267cceba" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-3ee9fa39-ce5f-45df-a7d2-de33267cceba" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Deleting offline snapshot 3ee9fa39-ce5f-45df-a7d2-de33267cceba of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] snapshot_file for this snap is: volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[098805f5-bf82-4130-8dfc-fcd7fc9cf016]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:31 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba
Sep 08 16:37:31 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:31 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 1073741824" returned: 0 in 0.447s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:31 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba" returned: 0 in 0.394s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cfb0ff-d4f9-4f8d-a61c-715d6aa67fc2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:31 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479
Sep 08 16:37:31 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:31 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:31 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:31 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317a9fc5-174f-4e7f-8ace-0ebdcf31aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9281280-7084-439a-adfa-f028f0ed8479', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5215cbcb-30b6-4754-8264-e186c9332030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:31 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Volume volume-d9281280-7084-439a-adfa-f028f0ed8479 (d9281280-7084-439a-adfa-f028f0ed8479): created successfully
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5215cbcb-30b6-4754-8264-e186c9332030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Flow 'volume_create_manager' (954304f9-cb39-40a6-9cc1-f4d4c05cf9b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:32 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-85efaf19-8c32-4814-a7d6-5d81e17e748c tempest-VolumesDeleteCascade-953838763 None] Created volume successfully.
Sep 08 16:37:32 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.489s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:32 devstack sudo[95407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba
Sep 08 16:37:32 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (166d95ec-94ed-4c9d-b8d3-fbfb4bab21da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fc3aaf-e7b3-44f3-9dd0-265c76412363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fc3aaf-e7b3-44f3-9dd0-265c76412363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1813303097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98999451-0039-43c9-9d3b-e68de780c295,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=14be8f36-30b5-4893-8a8f-cd44f345b4f3,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:32Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57589f2-3bfe-4ce9-8159-d50dabd9a10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57589f2-3bfe-4ce9-8159-d50dabd9a10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d22b19-67fe-479f-b376-30a3d47710ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d22b19-67fe-479f-b376-30a3d47710ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '98999451-0039-43c9-9d3b-e68de780c295', 'volume_name': 'volume-98999451-0039-43c9-9d3b-e68de780c295', 'volume_size': 1, 'source_volid': '14be8f36-30b5-4893-8a8f-cd44f345b4f3', 'source_volstatus': 'available'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6710f287-6c1c-492e-9631-a8fa205aee9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6710f287-6c1c-492e-9631-a8fa205aee9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebb9892-a18d-4e62-ba6e-2f94c1d7b174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:32 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Volume 98999451-0039-43c9-9d3b-e68de780c295: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-98999451-0039-43c9-9d3b-e68de780c295', 'volume_size': 1, 'source_volid': '14be8f36-30b5-4893-8a8f-cd44f345b4f3', 'source_volstatus': 'available'}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:32 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Cloning volume 14be8f36-30b5-4893-8a8f-cd44f345b4f3 to volume 98999451-0039-43c9-9d3b-e68de780c295
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Creating offline snapshot c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 of volume 14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:32 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba" returned: 0 in 0.524s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ef75d-1ef3-4be7-811e-bbf8df57c61c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:32 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba
Sep 08 16:37:32 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:32 devstack sudo[95435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3
Sep 08 16:37:32 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:32 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.3ee9fa39-ce5f-45df-a7d2-de33267cceba" returned: 0 in 0.352s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-3ee9fa39-ce5f-45df-a7d2-de33267cceba" released by "_delete_snapshot" :: held 1.915s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" released by "delete_snapshot" :: held 1.943s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Created reservations ['d1c58ab0-d1e6-4d13-aa5b-5f80d7cf7909', '38187227-6865-4c8d-85b4-23def66030b7', '848177c9-5e09-4c62-93c0-e1ac0439b5fa', 'e6b9e47e-c029-4376-8a02-02fa1266b821'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:33 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3" returned: 0 in 0.524s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:33 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 1G
Sep 08 16:37:33 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:33 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Delete snapshot completed successfully.
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49aaaecd-5be0-45ae-949c-eaa00a39b749 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-3ee9fa39-ce5f-45df-a7d2-de33267cceba-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:33 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 1G" returned: 0 in 0.440s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:33 devstack sudo[95455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8
Sep 08 16:37:33 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:33 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" returned: 0 in 0.273s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:33 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 is being set with open permissions: ugo+rw
Sep 08 16:37:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:33 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8
Sep 08 16:37:33 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:34 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" returned: 0 in 0.229s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:34 devstack sudo[95463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.info
Sep 08 16:37:34 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:34 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.info" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:34 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.info is being set with open permissions: ugo+rw
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:34 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.info
Sep 08 16:37:34 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:34 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.info" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-98999451-0039-43c9-9d3b-e68de780c295" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-98999451-0039-43c9-9d3b-e68de780c295" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] snapshot: c95e0aff-6c39-4a3e-a9f8-90baf6c469c8, volume: 98999451-0039-43c9-9d3b-e68de780c295,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0971e-1521-4d7f-97fb-fefdbf91d5a4]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:34 devstack sudo[95469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8
Sep 08 16:37:34 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:35 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[314aac97-7e38-4bda-b609-ee4b6fa4532f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:35 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3
Sep 08 16:37:35 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:35 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3" returned: 0 in 0.330s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:37:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:35 devstack sudo[95480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295
Sep 08 16:37:35 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:39 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295" returned: 0 in 3.724s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3, size 1024.00 MB, duration 3.73 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:37:39 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Converted 1024.00 MB image at 274.88 MB/s
Sep 08 16:37:39 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295 is being set with open permissions: ugo+rw
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:39 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295
Sep 08 16:37:39 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:39 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295" returned: 0 in 0.226s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-98999451-0039-43c9-9d3b-e68de780c295" released by "_copy_volume_from_snapshot" :: held 4.677s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Deleting offline snapshot c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 of volume 14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] snapshot_file for this snap is: volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f4e449-2bf3-4fe6-b84b-1b471e59e0d1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:39 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8
Sep 08 16:37:39 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:39 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" returned: 0 in 0.354s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb0510-5f15-4001-8b98-6fa047319908]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:39 devstack sudo[95501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3
Sep 08 16:37:39 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:40 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3" returned: 0 in 0.530s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:40 devstack sudo[95506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8
Sep 08 16:37:40 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:40 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" returned: 0 in 0.338s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:40 devstack sudo[95511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8
Sep 08 16:37:40 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:40 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3.c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" returned: 0 in 0.259s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-c95e0aff-6c39-4a3e-a9f8-90baf6c469c8" released by "_delete_snapshot" :: held 1.580s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.435s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.536s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ebb9892-a18d-4e62-ba6e-2f94c1d7b174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98999451-0039-43c9-9d3b-e68de780c295', 'volume_size': 1, 'source_volid': '14be8f36-30b5-4893-8a8f-cd44f345b4f3', 'source_volstatus': 'available'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cabf2f-f4e7-446c-a0ab-d8c3ab3250ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Creating offline snapshot ae6613ca-067d-44d6-9201-4355beb339c2 of volume d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:41 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Volume volume-98999451-0039-43c9-9d3b-e68de780c295 (98999451-0039-43c9-9d3b-e68de780c295): created successfully
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cabf2f-f4e7-446c-a0ab-d8c3ab3250ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (166d95ec-94ed-4c9d-b8d3-fbfb4bab21da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b2fae-ea4c-4663-97d4-4a68b0b93674]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a3e3768a-b91c-4791-b937-7aba40098f81 tempest-VolumesGetTest-1452743895 None] Created volume successfully.
Sep 08 16:37:41 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479
Sep 08 16:37:41 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:41 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479" returned: 0 in 0.357s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:41 devstack sudo[95519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 1G
Sep 08 16:37:41 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:41 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 1G" returned: 0 in 0.368s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:41 devstack sudo[95524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2
Sep 08 16:37:41 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:42 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2" returned: 0 in 0.277s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:42 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 is being set with open permissions: ugo+rw
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:42 devstack sudo[95529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2
Sep 08 16:37:42 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:42 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2" returned: 0 in 0.243s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:42 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.info
Sep 08 16:37:42 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:42 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.info" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:42 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.info is being set with open permissions: ugo+rw
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:42 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.info
Sep 08 16:37:42 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:42 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.info" returned: 0 in 0.290s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.406s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Creating offline snapshot c3cba43b-9ead-4646-9ef7-11cc2dcaf81b of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:42 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-59d35034-386d-416a-b52a-6fe2f32e58c9 tempest-VolumesDeleteCascade-953838763 None] Create snapshot completed successfully
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a301a3ff-d2d9-49bf-815d-01f6d3843ad6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (fc936cb2-0d9c-4f2c-a3f5-1312bb7feb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e06efd-6904-4031-8571-acff1a1d4dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e06efd-6904-4031-8571-acff1a1d4dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-799032250',display_name='tempest-VolumesGetTest-Volume-397930379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e9a2da-a63d-4c2d-8966-44204479f219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:43Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de339456-a019-4aac-a79e-2a6f38c160c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de339456-a019-4aac-a79e-2a6f38c160c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30628529-bd3c-4055-8c0b-0b27f8874748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30628529-bd3c-4055-8c0b-0b27f8874748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e9a2da-a63d-4c2d-8966-44204479f219', 'volume_name': 'volume-b7e9a2da-a63d-4c2d-8966-44204479f219', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73756e2f-9465-47e1-9436-5472e30cddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73756e2f-9465-47e1-9436-5472e30cddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:43 devstack sudo[95538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:43 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a621dfc-5baa-4e69-b9dd-4e15042907e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:43 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Volume b7e9a2da-a63d-4c2d-8966-44204479f219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e9a2da-a63d-4c2d-8966-44204479f219', 'volume_size': 1}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:43 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.365s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:43 devstack sudo[95544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b 1G
Sep 08 16:37:43 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:43 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b 1G" returned: 0 in 0.449s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:43 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b
Sep 08 16:37:43 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:44 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" returned: 0 in 0.435s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:44 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b is being set with open permissions: ugo+rw
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:44 devstack sudo[95557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b
Sep 08 16:37:44 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:44 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Flow 'volume_create_manager' (7181bd50-1c80-49c4-a4c2-8ea7e480af40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27546f5d-36a9-4c84-a9e0-d806bca78fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" returned: 0 in 0.278s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27546f5d-36a9-4c84-a9e0-d806bca78fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1526964511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e80d79-9e5c-40e2-9dc3-e1b191c87156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b6e941988a4eb08401b7bbe45ebffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:44Z,use_quota=True,user_id='dd34c8a83ac64ab18890e6ff9f470a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42926b8-c652-4f3c-86a0-e10dfba5bef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42926b8-c652-4f3c-86a0-e10dfba5bef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daec496-d978-44af-9fb5-b44e4b8c3e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daec496-d978-44af-9fb5-b44e4b8c3e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e80d79-9e5c-40e2-9dc3-e1b191c87156', 'volume_name': 'volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc73bf1-4aed-4e0a-b903-5cfc0fe98401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc73bf1-4aed-4e0a-b903-5cfc0fe98401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551ce7f9-2b66-4477-bf91-2d7dbe385192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:44 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Volume d1e80d79-9e5c-40e2-9dc3-e1b191c87156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156', 'volume_size': 1}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.679s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.490s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:43Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-799032250',display_name='tempest-VolumesGetTest-Volume-397930379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e9a2da-a63d-4c2d-8966-44204479f219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:43Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Creating volume b7e9a2da-a63d-4c2d-8966-44204479f219 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:44 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:44 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219 1073741824
Sep 08 16:37:44 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:44 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-32df8981-4f8a-404a-95b8-364f05909193 tempest-SnapshotsActionsTest-1034072052 None] Create snapshot completed successfully
Sep 08 16:37:45 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219 1073741824" returned: 0 in 0.476s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:45 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219
Sep 08 16:37:45 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-c3cba43b-9ead-4646-9ef7-11cc2dcaf81b-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-c3cba43b-9ead-4646-9ef7-11cc2dcaf81b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Deleting offline snapshot c3cba43b-9ead-4646-9ef7-11cc2dcaf81b of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] snapshot_file for this snap is: volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa756e3-7c8d-4b79-8f10-a115db6fc646]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:45 devstack sudo[95569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b
Sep 08 16:37:45 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:45 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219" returned: 0 in 0.270s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.942s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Creating offline snapshot cae9dd6b-3027-428f-afe8-7ae69f219816 of volume d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a621dfc-5baa-4e69-b9dd-4e15042907e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e9a2da-a63d-4c2d-8966-44204479f219', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb085cf7-4563-4b1d-b198-f00db701764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[da686650-2f4d-46f1-afd2-2fdd1718fa43]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:45 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Volume volume-b7e9a2da-a63d-4c2d-8966-44204479f219 (b7e9a2da-a63d-4c2d-8966-44204479f219): created successfully
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb085cf7-4563-4b1d-b198-f00db701764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (fc936cb2-0d9c-4f2c-a3f5-1312bb7feb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:45 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-48203cab-01af-4f4f-961d-2a660330e772 tempest-VolumesGetTest-1452743895 None] Created volume successfully.
Sep 08 16:37:45 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" returned: 0 in 0.362s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:45 devstack sudo[95572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2
Sep 08 16:37:45 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2c952b-d461-4625-b17c-ace3fe42f68d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:45 devstack sudo[95577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:45 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:45 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2" returned: 0 in 0.358s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9281280-7084-439a-adfa-f028f0ed8479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:45 devstack sudo[95582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 1G
Sep 08 16:37:45 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:45 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:46 devstack sudo[95587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b
Sep 08 16:37:46 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-b7e9a2da-a63d-4c2d-8966-44204479f219-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Lock "cinder-b7e9a2da-a63d-4c2d-8966-44204479f219-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-b7e9a2da-a63d-4c2d-8966-44204479f219" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-b7e9a2da-a63d-4c2d-8966-44204479f219" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:46 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 1G" returned: 0 in 0.538s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9fe578-4b7f-4794-a694-8610bd131ccc]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:46 devstack sudo[95599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816
Sep 08 16:37:46 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:46 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" returned: 0 in 0.448s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:46 devstack sudo[95602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b
Sep 08 16:37:46 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:46 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219
Sep 08 16:37:46 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:46 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" returned: 0 in 0.255s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:46 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816" returned: 0 in 0.326s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:46 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 is being set with open permissions: ugo+rw
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-c3cba43b-9ead-4646-9ef7-11cc2dcaf81b" released by "_delete_snapshot" :: held 1.516s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" released by "delete_snapshot" :: held 1.547s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:46 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816
Sep 08 16:37:46 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Created reservations ['b21efded-d851-4f6c-96bf-0fe0e9613f92', '5fcf6337-c803-430c-817e-a539020641cc', 'be05eba2-dbae-40d8-a298-8bb9f6f7f4e8', '1f03cef4-b6b5-4426-a318-c4d24b1c1951'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:46 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219" returned: 0 in 0.408s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:46 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219
Sep 08 16:37:46 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:46 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Delete snapshot completed successfully.
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-15dc9e0a-5b42-4a37-8cce-6d7e03db4881 tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-c3cba43b-9ead-4646-9ef7-11cc2dcaf81b-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:46 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816" returned: 0 in 0.261s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.613s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.428s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1526964511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e80d79-9e5c-40e2-9dc3-e1b191c87156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b6e941988a4eb08401b7bbe45ebffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:44Z,use_quota=True,user_id='dd34c8a83ac64ab18890e6ff9f470a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Creating volume d1e80d79-9e5c-40e2-9dc3-e1b191c87156 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:47 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:47 devstack sudo[95617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156 1073741824
Sep 08 16:37:47 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:47 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8355310c-e565-4f47-94f3-eefade6c5011 tempest-VolumesDeleteCascade-953838763 None] Create snapshot completed successfully
Sep 08 16:37:47 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-b7e9a2da-a63d-4c2d-8966-44204479f219" returned: 0 in 0.269s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-b7e9a2da-a63d-4c2d-8966-44204479f219" released by "delete_volume" :: held 0.732s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Created reservations ['79496c7a-9ce4-4c8e-9304-583ef7ac00a7', 'c9ecbfa1-be18-48b0-af73-35fb8de2287c', 'c1d116ab-3ed8-4c71-b761-58a793fe8b04', 'a6f6f6c6-d62d-433f-b34d-e5cbab3d77c4'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:47 devstack sudo[95620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:47 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:47 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.308s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:47 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Deleted volume successfully.
Sep 08 16:37:47 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-d9281280-7084-439a-adfa-f028f0ed8479-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156 1073741824" returned: 0 in 0.564s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-d9281280-7084-439a-adfa-f028f0ed8479-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8198e986-718e-49b3-9c8f-effcb654c2a0 tempest-VolumesGetTest-1452743895 None] Lock "cinder-b7e9a2da-a63d-4c2d-8966-44204479f219-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-98999451-0039-43c9-9d3b-e68de780c295-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Performing cascade delete. {{(pid=87505) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 08 16:37:47 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156
Sep 08 16:37:47 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-ae6613ca-067d-44d6-9201-4355beb339c2-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Lock "cinder-98999451-0039-43c9-9d3b-e68de780c295-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-ae6613ca-067d-44d6-9201-4355beb339c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-ae6613ca-067d-44d6-9201-4355beb339c2" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-98999451-0039-43c9-9d3b-e68de780c295" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-ae6613ca-067d-44d6-9201-4355beb339c2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Deleting offline snapshot ae6613ca-067d-44d6-9201-4355beb339c2 of volume d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] snapshot_file for this snap is: volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-98999451-0039-43c9-9d3b-e68de780c295" acquired by "delete_volume" :: waited 0.067s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aafd614-4811-4963-a4bf-fe376be9a907]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f2ab5b-ac2a-40c9-bef8-f84182ac675a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:47 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156" returned: 0 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.051s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551ce7f9-2b66-4477-bf91-2d7dbe385192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0307e274-e5dd-4dfb-b7d4-efd3d75542a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:48 devstack sudo[95629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2
Sep 08 16:37:48 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Creating offline snapshot 72a6a3d6-a151-4513-8a0d-81198d1cbabd of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:48 devstack sudo[95630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295
Sep 08 16:37:48 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Volume volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156 (d1e80d79-9e5c-40e2-9dc3-e1b191c87156): created successfully
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0307e274-e5dd-4dfb-b7d4-efd3d75542a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Flow 'volume_create_manager' (7181bd50-1c80-49c4-a4c2-8ea7e480af40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331605b-ecf4-4245-a45d-6e24333324ca]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-597cfd17-7216-4ce1-983c-9dffa54c73a3 tempest-AttachVolumeNegativeTest-1876492861 None] Created volume successfully.
Sep 08 16:37:48 devstack sudo[95634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:48 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:48 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:48 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295" returned: 0 in 0.371s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2" returned: 0 in 0.400s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9281280-7084-439a-adfa-f028f0ed8479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:48 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295
Sep 08 16:37:48 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6185f60-ba6f-49f2-930b-8988fb8ad4a6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:48 devstack sudo[95645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479
Sep 08 16:37:48 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:48 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.379s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:48 devstack sudo[95651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd 1G
Sep 08 16:37:48 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:48 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-98999451-0039-43c9-9d3b-e68de780c295" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-98999451-0039-43c9-9d3b-e68de780c295" released by "delete_volume" :: held 0.671s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Created reservations ['c77c2aad-7d92-42a2-8f78-34feabc5ff2e', '98da2ab9-b52e-4440-aa1d-21beb6aa864b', '1580fa3b-63fd-469b-952a-806bd083ecc0', '048d2ec4-80b5-4512-b8e5-6886d3ac6343'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:48 devstack sudo[95659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:48 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:48 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479" returned: 0 in 0.442s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec3b92-bfc4-4a06-a830-06222232b2e2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:48 devstack sudo[95667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816
Sep 08 16:37:48 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:49 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd 1G" returned: 0 in 0.572s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:49 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd
Sep 08 16:37:49 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-14be8f36-30b5-4893-8a8f-cd44f345b4f3-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Lock "cinder-14be8f36-30b5-4893-8a8f-cd44f345b4f3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:49 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.420s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Deleted volume successfully.
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-14be8f36-30b5-4893-8a8f-cd44f345b4f3" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76d1e373-7000-4fbc-b3e8-582cacc76ec1 tempest-VolumesGetTest-1452743895 None] Lock "cinder-98999451-0039-43c9-9d3b-e68de780c295-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-14be8f36-30b5-4893-8a8f-cd44f345b4f3" acquired by "delete_volume" :: waited 0.038s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4c3364-7a92-4d11-abfb-deb3498ac23b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:49 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816" returned: 0 in 0.561s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9281280-7084-439a-adfa-f028f0ed8479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2131138f-b2a7-42df-9755-d6b66febd4b1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:49 devstack sudo[95675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3
Sep 08 16:37:49 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:49 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd" returned: 0 in 0.463s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:49 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd is being set with open permissions: ugo+rw
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:49 devstack sudo[95685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd
Sep 08 16:37:49 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:49 devstack sudo[95680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2
Sep 08 16:37:49 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-44ffabf8-8d81-4ab3-8a14-b3825b0f8c6f req-66b585a4-1252-444a-aded-db1861d2e780 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:49 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3" returned: 0 in 0.497s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:49 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:49 devstack sudo[95733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3
Sep 08 16:37:49 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd" returned: 0 in 0.332s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:49 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-44ffabf8-8d81-4ab3-8a14-b3825b0f8c6f req-66b585a4-1252-444a-aded-db1861d2e780 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.092s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2" returned: 0 in 0.476s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9281280-7084-439a-adfa-f028f0ed8479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee851f2e-7adc-49b0-9f5f-ef7cbf49d308]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-44ffabf8-8d81-4ab3-8a14-b3825b0f8c6f req-66b585a4-1252-444a-aded-db1861d2e780 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a65c2659-ea1c-4591-9b74-c8a95c9c0039 tempest-SnapshotsActionsTest-1034072052 None] Create snapshot completed successfully
Sep 08 16:37:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-44ffabf8-8d81-4ab3-8a14-b3825b0f8c6f req-66b585a4-1252-444a-aded-db1861d2e780 tempest-AttachVolumeNegativeTest-1876492861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67260c74-e639-42b8-8bac-af1775c1637b', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:37:50 devstack sudo[95736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479
Sep 08 16:37:50 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-44ffabf8-8d81-4ab3-8a14-b3825b0f8c6f req-66b585a4-1252-444a-aded-db1861d2e780 tempest-AttachVolumeNegativeTest-1876492861 None] attachment_update completed successfully.
Sep 08 16:37:50 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-14be8f36-30b5-4893-8a8f-cd44f345b4f3" returned: 0 in 0.380s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-14be8f36-30b5-4893-8a8f-cd44f345b4f3" released by "delete_volume" :: held 0.975s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-72a6a3d6-a151-4513-8a0d-81198d1cbabd-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-72a6a3d6-a151-4513-8a0d-81198d1cbabd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Acquiring lock "cinder-quobyte-72a6a3d6-a151-4513-8a0d-81198d1cbabd" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-72a6a3d6-a151-4513-8a0d-81198d1cbabd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Deleting offline snapshot 72a6a3d6-a151-4513-8a0d-81198d1cbabd of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] snapshot_file for this snap is: volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[78194c6f-a486-45d4-bb71-1e0b3d56a28f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Created reservations ['5f25376d-8c7f-4962-933e-3513f8b1a65c', 'ae8fad68-d7f7-4804-9401-5596a88caa78', '796c86d2-67d9-4cf7-b133-bd7b2e305b82', '593c077e-722a-4c5b-8321-f77f46ced67e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:50 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479" returned: 0 in 0.548s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:50 devstack sudo[95813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:50 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:50 devstack sudo[95789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd
Sep 08 16:37:50 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:50 devstack sudo[95845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2
Sep 08 16:37:50 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:50 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.279s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Deleted volume successfully.
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b4afc7e6-7cf5-4a4a-a330-1287b6818cd8 tempest-VolumesGetTest-1452743895 None] Lock "cinder-14be8f36-30b5-4893-8a8f-cd44f345b4f3-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:50 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd" returned: 0 in 0.496s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fcd7e6-73d4-40d7-b098-69552e82f18b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:50 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2" returned: 0 in 0.470s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:50 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2
Sep 08 16:37:50 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:51 devstack sudo[96140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:51 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:51 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.ae6613ca-067d-44d6-9201-4355beb339c2" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 -F qcow2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:51 devstack sudo[96145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 -F qcow2
Sep 08 16:37:51 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:51 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.483s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:51 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd
Sep 08 16:37:51 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:51 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9281280-7084-439a-adfa-f028f0ed8479 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 -F qcow2" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-ae6613ca-067d-44d6-9201-4355beb339c2" released by "_delete_snapshot" :: held 3.738s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" released by "delete_snapshot" :: held 3.775s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Created reservations ['632c23d9-74e1-477a-aa8b-93da3ca191d8', 'aa62ba02-36bb-4e60-9c5c-23d42346e1e5', 'e2587e93-beb1-445b-97b4-734ab0080218', 'b5d92661-a378-4c4e-8c36-9795acb43529'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Delete snapshot completed successfully.
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-ae6613ca-067d-44d6-9201-4355beb339c2-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-cae9dd6b-3027-428f-afe8-7ae69f219816-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-cae9dd6b-3027-428f-afe8-7ae69f219816-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-cae9dd6b-3027-428f-afe8-7ae69f219816" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-cae9dd6b-3027-428f-afe8-7ae69f219816" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Deleting offline snapshot cae9dd6b-3027-428f-afe8-7ae69f219816 of volume d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] snapshot_file for this snap is: volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[955517a2-e66a-426b-b0bd-4d2cf1d670ca]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:51 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd" returned: 0 in 0.537s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:51 devstack sudo[96159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd
Sep 08 16:37:51 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:52 devstack sudo[96158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816
Sep 08 16:37:52 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:52 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (015b5717-afa2-4c61-ad18-390af1bb96bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b71e374-a28d-4110-90c5-5f66be00a6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.72a6a3d6-a151-4513-8a0d-81198d1cbabd" returned: 0 in 0.471s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b71e374-a28d-4110-90c5-5f66be00a6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1115190949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5a6162-c8f5-4ccb-8fe2-7d23912306ad,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:52Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e471811-45f0-4825-b82f-68a9c22000ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e471811-45f0-4825-b82f-68a9c22000ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c7a2bd-1958-4db4-a3df-221f46416f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-72a6a3d6-a151-4513-8a0d-81198d1cbabd" released by "_delete_snapshot" :: held 2.136s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" released by "delete_snapshot" :: held 2.171s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:52 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816" returned: 0 in 0.591s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9281280-7084-439a-adfa-f028f0ed8479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8dce35-49d5-42bc-8ca2-40c262ffc964]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Created reservations ['d9fe0b79-e66e-4d2d-9ad4-00b69b759567', '8f4a86ff-7d50-4c32-9484-c310745b8ed8', 'f5fdb70a-125e-40ae-abff-b16489ab15cf', 'a0bd95f5-051a-4e33-b96f-2a0ec8c159b3'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Delete snapshot completed successfully.
Sep 08 16:37:52 devstack sudo[96167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9142b801-8d9f-4255-822f-7139fdd5e44d tempest-SnapshotsActionsTest-1865660243 None] Lock "cinder-72a6a3d6-a151-4513-8a0d-81198d1cbabd-delete_snapshot" released by "delete_snapshot" :: held 2.399s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:52 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c7a2bd-1958-4db4-a3df-221f46416f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc5a6162-c8f5-4ccb-8fe2-7d23912306ad', 'volume_name': 'volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343646faa0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe581d4-8d76-4564-811c-e35b2a51ef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe581d4-8d76-4564-811c-e35b2a51ef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7856cbfd-3aaf-4ace-b718-60884457e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Volume cc5a6162-c8f5-4ccb-8fe2-7d23912306ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343646faa0>}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Trying to clone cc5a6162-c8f5-4ccb-8fe2-7d23912306ad from image 9bf04763-a04a-46d0-817b-b7085cff6448 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:37:52 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479" returned: 0 in 0.447s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:52 devstack sudo[96173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816
Sep 08 16:37:52 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:37:53 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Image download 20.69 MB at 20.69 MB/s
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d39e77-0f0d-49b8-8325-ebad0bbe0afd]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:53 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816" returned: 0 in 0.424s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:53 devstack sudo[96181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816
Sep 08 16:37:53 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:53 devstack sudo[96180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD
Sep 08 16:37:53 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:53 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479.cae9dd6b-3027-428f-afe8-7ae69f219816" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-cae9dd6b-3027-428f-afe8-7ae69f219816" released by "_delete_snapshot" :: held 1.874s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" released by "delete_snapshot" :: held 1.902s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:53 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 is fetched for user 18a9b9b7e5824b24a7e7a1cdbd4ddc4b. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Created reservations ['c4e6ddc9-1479-442e-8d7e-385051ed7619', 'e07f510e-2b78-44b1-b3b9-959c4a885bf0', 'c71c9c80-ddbc-48ab-9f0d-c7cda1444de9', '2df3d7dd-a1e4-4e00-931e-669ee429f4e9'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e6b7df-1b91-4391-b6ab-c8c14414cb80]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Delete snapshot completed successfully.
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-cae9dd6b-3027-428f-afe8-7ae69f219816-delete_snapshot" released by "delete_snapshot" :: held 2.143s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Snapshots deleted, issuing volume delete {{(pid=87505) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:53 devstack sudo[96189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD
Sep 08 16:37:53 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6839a027-3d80-4676-a57b-7811bf509c65]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "cinder-e85c98c6-6786-46ea-b5c6-c487ce705d5c-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-e85c98c6-6786-46ea-b5c6-c487ce705d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "cinder-quobyte-e85c98c6-6786-46ea-b5c6-c487ce705d5c" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-quobyte-e85c98c6-6786-46ea-b5c6-c487ce705d5c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Deleting offline snapshot e85c98c6-6786-46ea-b5c6-c487ce705d5c of volume 04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] snapshot_file for this snap is: volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:37:54 devstack sudo[96191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479
Sep 08 16:37:54 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f37a660-b096-4566-83f9-6c471c2ce9e5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:54 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1115190949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5a6162-c8f5-4ccb-8fe2-7d23912306ad,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:52Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Creating volume cc5a6162-c8f5-4ccb-8fe2-7d23912306ad {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:54 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:54 devstack sudo[96193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:54 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:54 devstack sudo[96197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad 1073741824
Sep 08 16:37:54 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:54 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479" returned: 0 in 0.466s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:54 devstack sudo[96204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479
Sep 08 16:37:54 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:54 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.460s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f7b85e-ab24-426e-9650-2c337de5bb70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[20290d89-00db-4dae-8183-5e4de7ef93bb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:54 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d9281280-7084-439a-adfa-f028f0ed8479" returned: 0 in 0.300s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:54 devstack sudo[96212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70
Sep 08 16:37:54 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:54 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad 1073741824" returned: 0 in 0.521s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-d9281280-7084-439a-adfa-f028f0ed8479" released by "delete_volume" :: held 0.850s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:54 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad
Sep 08 16:37:54 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Created reservations ['f8df8b7d-b9ba-428c-88f7-8e15dca7f104', 'aa8e20f0-bee0-4251-b065-75427712e875', '78e141e7-50ab-47eb-af08-64d0a1271c2f', '9afa7055-2871-4110-adef-3fd446ece633'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:54 devstack sudo[96219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:54 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:55 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70" returned: 0 in 0.432s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:55 devstack sudo[96223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:55 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:55 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Attempting download of 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume cc5a6162-c8f5-4ccb-8fe2-7d23912306ad. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:37:55 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.311s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:55 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Deleted volume successfully.
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[20da179e-dfae-4054-9fb1-fb60913bb3bd]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_lol1hna2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4a487fa9-586d-41e2-9c7f-9e8b683f7053 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-d9281280-7084-439a-adfa-f028f0ed8479-delete_volume" released by "delete_volume" :: held 7.784s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:55 devstack sudo[96229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_lol1hna2
Sep 08 16:37:55 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:55 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.585s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:55 devstack sudo[96236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c
Sep 08 16:37:55 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:55 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_lol1hna2" returned: 0 in 0.483s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_lol1hna2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:55 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_lol1hna2
Sep 08 16:37:55 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:55 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70.e85c98c6-6786-46ea-b5c6-c487ce705d5c" returned: 0 in 0.327s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-quobyte-e85c98c6-6786-46ea-b5c6-c487ce705d5c" released by "_delete_snapshot" :: held 1.952s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" released by "delete_snapshot" :: held 1.987s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Created reservations ['7e3f79e0-36de-4631-ac83-743aaf4aa459', '3212de8d-a97b-4f7a-a689-9b3797ba1073', '53f3feef-0651-472a-a91c-2cfbc027f952', '780fdfb1-cd84-40ec-a798-d3499052ad53'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:56 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_lol1hna2" returned: 1 in 0.443s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_lol1hna2' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da32464-722e-4517-af19-9725e3edee5f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Delete snapshot completed successfully.
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b8ff2dca-f08a-440d-8f0b-c7ee6f066970 tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-e85c98c6-6786-46ea-b5c6-c487ce705d5c-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:56 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:37:56 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Flow 'volume_create_manager' (674a61a6-03d9-4d23-9eb8-780c91335afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dec8ad4-f32d-48aa-b562-a75d7e6bd79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dec8ad4-f32d-48aa-b562-a75d7e6bd79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-199664931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00adf4a6-960a-40f5-a3ab-a798907e6e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf16a69e50145c0bfc9cb847cd610ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:56Z,use_quota=True,user_id='650984eb79f34554b17379bbec51aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec187c7c-74db-43b1-abe3-681be67e1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec187c7c-74db-43b1-abe3-681be67e1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33acfbe-a879-4d08-8cd3-ef7ad62e5287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33acfbe-a879-4d08-8cd3-ef7ad62e5287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00adf4a6-960a-40f5-a3ab-a798907e6e52', 'volume_name': 'volume-00adf4a6-960a-40f5-a3ab-a798907e6e52', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64565a9d-8474-4aaf-8b44-371ae5ea3004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64565a9d-8474-4aaf-8b44-371ae5ea3004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a0a546-c5c9-4460-9cd4-2926d02c9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:56 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Volume 00adf4a6-960a-40f5-a3ab-a798907e6e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00adf4a6-960a-40f5-a3ab-a798907e6e52', 'volume_size': 1}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-199664931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00adf4a6-960a-40f5-a3ab-a798907e6e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf16a69e50145c0bfc9cb847cd610ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:37:56Z,use_quota=True,user_id='650984eb79f34554b17379bbec51aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Creating volume 00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:37:56 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:56 devstack sudo[96248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 1073741824
Sep 08 16:37:56 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:56 devstack sudo[96250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:56 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:56 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] 9bf04763-a04a-46d0-817b-b7085cff6448 was qcow2, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:56 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad
Sep 08 16:37:56 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:56 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:37:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:37:57 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 1073741824" returned: 0 in 0.560s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:57 devstack sudo[96266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52
Sep 08 16:37:57 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "cinder-04f7b85e-ab24-426e-9650-2c337de5bb70-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:57 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52" returned: 0 in 0.401s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-04f7b85e-ab24-426e-9650-2c337de5bb70-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a0a546-c5c9-4460-9cd4-2926d02c9932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00adf4a6-960a-40f5-a3ab-a798907e6e52', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ef9af-1018-40d6-97b6-679b19dcf617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:37:57 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Volume volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 (00adf4a6-960a-40f5-a3ab-a798907e6e52): created successfully
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7ef9af-1018-40d6-97b6-679b19dcf617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Flow 'volume_create_manager' (674a61a6-03d9-4d23-9eb8-780c91335afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0057f89f-2343-44b5-bb43-15286ecbbdf1 tempest-VolumesDeleteCascade-953838763 None] Created volume successfully.
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" acquired by "delete_volume" :: waited 0.053s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6328e182-7a3a-459a-ad2b-725071d5d22b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:57 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70
Sep 08 16:37:57 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:58 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70" returned: 0 in 0.545s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:58 devstack sudo[96298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70
Sep 08 16:37:58 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:58 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-04f7b85e-ab24-426e-9650-2c337de5bb70" returned: 0 in 0.306s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-quobyte-04f7b85e-ab24-426e-9650-2c337de5bb70" released by "delete_volume" :: held 0.971s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Created reservations ['b2bd4092-f652-4be7-8a29-71ea31298685', '9c3b9a50-21f6-4046-bea2-83711f6095bb', '4d2c3e98-07b8-453c-9f38-93b5f1094f8e', '01d0f714-190c-44fd-b426-956913af0270'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Creating offline snapshot 3107d899-4a56-479d-841c-056e60fc513d of volume 00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6762ec-0c62-4d0f-82bd-81bf50be4e88]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:37:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:58 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:37:58 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:58 devstack sudo[96301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52
Sep 08 16:37:58 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:59 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad" returned: 0 in 2.485s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_icyrejaydevstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:37:59 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Converted 112.00 MB image at 45.00 MB/s
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:59 devstack sudo[96306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad 1G
Sep 08 16:37:59 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:59 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.377s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:37:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Deleted volume successfully.
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-42d33215-fd6c-407a-ac96-21f6bec73f7d tempest-SnapshotsActionsTest-1034072052 None] Lock "cinder-04f7b85e-ab24-426e-9650-2c337de5bb70-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:37:59 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52" returned: 0 in 0.507s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:59 devstack sudo[96312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d 1G
Sep 08 16:37:59 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:37:59 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad 1G" returned: 0 in 0.361s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Downloaded image 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume cc5a6162-c8f5-4ccb-8fe2-7d23912306ad successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 for user 18a9b9b7e5824b24a7e7a1cdbd4ddc4b is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Marking volume cc5a6162-c8f5-4ccb-8fe2-7d23912306ad as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Copying metadata from image 9bf04763-a04a-46d0-817b-b7085cff6448 to cc5a6162-c8f5-4ccb-8fe2-7d23912306ad. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Creating volume glance metadata for volume cc5a6162-c8f5-4ccb-8fe2-7d23912306ad backed by image 9bf04763-a04a-46d0-817b-b7085cff6448 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7856cbfd-3aaf-4ace-b718-60884457e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343646faa0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b121b3-215c-4323-bef3-b2cfb566c28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:37:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Volume volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad (cc5a6162-c8f5-4ccb-8fe2-7d23912306ad): created successfully
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b121b3-215c-4323-bef3-b2cfb566c28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (015b5717-afa2-4c61-ad18-390af1bb96bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:37:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-57b9316c-6fd6-4913-9a40-8710cfd4ba55 tempest-VolumesGetTest-1452743895 None] Created volume successfully.
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d 1G" returned: 0 in 0.560s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:37:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:37:59 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root
Sep 08 16:37:59 devstack sudo[96321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d
Sep 08 16:37:59 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:00 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d" returned: 0 in 0.615s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:00 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d is being set with open permissions: ugo+rw
Sep 08 16:38:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:00 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d
Sep 08 16:38:00 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:00 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d" returned: 0 in 0.426s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:01 devstack sudo[96368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.info
Sep 08 16:38:01 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (006d900c-8d16-44da-ad6b-405f42527360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09de602-189a-46e8-8dc0-c727427ebbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:01 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.info" returned: 0 in 0.388s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:01 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.info is being set with open permissions: ugo+rw
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09de602-189a-46e8-8dc0-c727427ebbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1888704957',display_name='tempest-VolumesGetTest-Volume-1496827526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f719d34-8b36-43aa-a747-3299a3de7e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:01Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:01 devstack sudo[96372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.info
Sep 08 16:38:01 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f5fa41-7a1a-4fa8-8a33-155f33572d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f5fa41-7a1a-4fa8-8a33-155f33572d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82488cc8-803e-446a-a075-c4de49faa710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82488cc8-803e-446a-a075-c4de49faa710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f719d34-8b36-43aa-a747-3299a3de7e0e', 'volume_name': 'volume-2f719d34-8b36-43aa-a747-3299a3de7e0e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c63a8b-d2cf-4619-950b-417cfa9d365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c63a8b-d2cf-4619-950b-417cfa9d365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5759ddeb-8c4e-46be-a588-16442fcbddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:01 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Volume 2f719d34-8b36-43aa-a747-3299a3de7e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f719d34-8b36-43aa-a747-3299a3de7e0e', 'volume_size': 1}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:01 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.info" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1888704957',display_name='tempest-VolumesGetTest-Volume-1496827526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f719d34-8b36-43aa-a747-3299a3de7e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bd9b90b2f33476f8bc112c199334fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:01Z,use_quota=True,user_id='18a9b9b7e5824b24a7e7a1cdbd4ddc4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Creating volume 2f719d34-8b36-43aa-a747-3299a3de7e0e {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:01 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:01 devstack sudo[96377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e 1073741824
Sep 08 16:38:01 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0403f014-7a49-4f5a-838f-13284353dd33 tempest-VolumesDeleteCascade-953838763 None] Create snapshot completed successfully
Sep 08 16:38:02 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e 1073741824" returned: 0 in 0.915s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:02 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e
Sep 08 16:38:02 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:02 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Flow 'volume_create_manager' (3b81e720-5e81-44cf-ba14-6cc1719c59ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f1eb6-e8d8-42e4-883c-acc2a0d6384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835f1eb6-e8d8-42e4-883c-acc2a0d6384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1981302161',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3267d7d-4489-43a3-820d-3393704ed0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bf16a69e50145c0bfc9cb847cd610ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3107d899-4a56-479d-841c-056e60fc513d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:03Z,use_quota=True,user_id='650984eb79f34554b17379bbec51aed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74534ba8-06e8-4f16-b2a7-e5a512a3f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74534ba8-06e8-4f16-b2a7-e5a512a3f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d5edae-3f73-4117-9f3b-46ffbcdfe197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d5edae-3f73-4117-9f3b-46ffbcdfe197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3267d7d-4489-43a3-820d-3393704ed0a9', 'volume_name': 'volume-a3267d7d-4489-43a3-820d-3393704ed0a9', 'volume_size': 1, 'snapshot_id': '3107d899-4a56-479d-841c-056e60fc513d'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a446fe79-0674-4810-b715-ad7686401000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a446fe79-0674-4810-b715-ad7686401000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:03 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6279c4-346a-4bcf-b50d-cb44f6114975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:03 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Volume a3267d7d-4489-43a3-820d-3393704ed0a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3267d7d-4489-43a3-820d-3393704ed0a9', 'volume_size': 1, 'snapshot_id': '3107d899-4a56-479d-841c-056e60fc513d'}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e" returned: 0 in 0.348s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-3107d899-4a56-479d-841c-056e60fc513d-a3267d7d-4489-43a3-820d-3393704ed0a9" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5759ddeb-8c4e-46be-a588-16442fcbddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f719d34-8b36-43aa-a747-3299a3de7e0e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56252bd-2cac-4e51-860d-d7eb8681f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-3107d899-4a56-479d-841c-056e60fc513d-a3267d7d-4489-43a3-820d-3393704ed0a9" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Creating volume a3267d7d-4489-43a3-820d-3393704ed0a9 from snapshot 3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-a3267d7d-4489-43a3-820d-3393704ed0a9" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:03 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Volume volume-2f719d34-8b36-43aa-a747-3299a3de7e0e (2f719d34-8b36-43aa-a747-3299a3de7e0e): created successfully
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56252bd-2cac-4e51-860d-d7eb8681f414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Flow 'volume_create_manager' (006d900c-8d16-44da-ad6b-405f42527360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-a3267d7d-4489-43a3-820d-3393704ed0a9" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] snapshot: 3107d899-4a56-479d-841c-056e60fc513d, volume: a3267d7d-4489-43a3-820d-3393704ed0a9,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b9c827c7-994e-41cd-b901-76724b3d06c2 tempest-VolumesGetTest-1452743895 None] Created volume successfully.
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65ee90a-e911-43b3-9adb-52f83e8b764f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:03 devstack sudo[96386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d
Sep 08 16:38:03 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-2f719d34-8b36-43aa-a747-3299a3de7e0e-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Lock "cinder-2f719d34-8b36-43aa-a747-3299a3de7e0e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-2f719d34-8b36-43aa-a747-3299a3de7e0e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-2f719d34-8b36-43aa-a747-3299a3de7e0e" acquired by "delete_volume" :: waited 0.040s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aecad73-ad6d-4caa-a24a-d47881cbf5ee]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:03 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d" returned: 0 in 0.639s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00adf4a6-960a-40f5-a3ab-a798907e6e52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847b749-377f-42c5-9bfd-8f35a520e7db]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:04 devstack sudo[96392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e
Sep 08 16:38:04 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:04 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52
Sep 08 16:38:04 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:04 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e" returned: 0 in 0.555s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:04 devstack sudo[96399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e
Sep 08 16:38:04 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:04 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52" returned: 0 in 0.591s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:04 devstack sudo[96404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9
Sep 08 16:38:04 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:04 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2f719d34-8b36-43aa-a747-3299a3de7e0e" returned: 0 in 0.389s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-2f719d34-8b36-43aa-a747-3299a3de7e0e" released by "delete_volume" :: held 1.041s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:04 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Created reservations ['08cc37d4-e9b1-40fa-83aa-b8e2a04a11e2', '1f91b003-33ab-483d-8ff0-a0a42277442e', 'ac973099-cf9b-408b-bc8d-5fff0cbf3859', '21fe4959-3986-4b53-a8aa-5e46dc80d746'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:05 devstack sudo[96410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:05 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:05 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.553s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Deleted volume successfully.
Sep 08 16:38:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4757f4a6-b226-42e9-be75-05fe33b58539 tempest-VolumesGetTest-1452743895 None] Lock "cinder-2f719d34-8b36-43aa-a747-3299a3de7e0e-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Lock "cinder-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Acquiring lock "cinder-quobyte-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad" acquired by "delete_volume" :: waited 0.041s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:06 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f78170f-76ee-4a9d-b223-db6b0642fc20]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:07 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad
Sep 08 16:38:07 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:08 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad" returned: 0 in 1.602s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:08 devstack sudo[96432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad
Sep 08 16:38:08 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:09 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad" returned: 0 in 0.722s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Lock "cinder-quobyte-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad" released by "delete_volume" :: held 2.482s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=188,cinder:SELECT=161,cinder:INSERT=64,cinder:DELETE=14 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Created reservations ['2779ed5d-2119-4dd6-92ca-12b21c2b3ce1', 'e51b86aa-3de7-47dd-8bbd-dcf1d28c1bb2', '5b4b119e-4314-4d1d-9477-e681dffc467d', '792f443b-9aef-4d39-86e9-6ba810e8b58c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:09 devstack sudo[96436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:09 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:10 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.692s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:10 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Deleted volume successfully.
Sep 08 16:38:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5dbc443c-c4d6-4b76-a70c-6ecf3e04f9fa tempest-VolumesGetTest-1452743895 None] Lock "cinder-cc5a6162-c8f5-4ccb-8fe2-7d23912306ad-delete_volume" released by "delete_volume" :: held 3.850s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:11 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9" returned: 0 in 7.026s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:38:11 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Converted 1024.00 MB image at 145.71 MB/s
Sep 08 16:38:11 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9 is being set with open permissions: ugo+rw
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:11 devstack sudo[96463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9
Sep 08 16:38:11 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:11 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9" returned: 0 in 0.269s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-a3267d7d-4489-43a3-820d-3393704ed0a9" released by "_copy_volume_from_snapshot" :: held 8.643s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-3107d899-4a56-479d-841c-056e60fc513d-a3267d7d-4489-43a3-820d-3393704ed0a9" released by "_create_volume_from_snapshot" :: held 8.762s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.803s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6279c4-346a-4bcf-b50d-cb44f6114975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3267d7d-4489-43a3-820d-3393704ed0a9', 'volume_size': 1, 'snapshot_id': '3107d899-4a56-479d-841c-056e60fc513d'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90b6130-9add-458d-8c1e-e4ac3f6e9a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:12 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Volume volume-a3267d7d-4489-43a3-820d-3393704ed0a9 (a3267d7d-4489-43a3-820d-3393704ed0a9): created successfully
Sep 08 16:38:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90b6130-9add-458d-8c1e-e4ac3f6e9a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Flow 'volume_create_manager' (3b81e720-5e81-44cf-ba14-6cc1719c59ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ab052508-c3a0-46d7-a9c2-e9dbedbe15a0 tempest-VolumesDeleteCascade-953838763 None] Created volume successfully.
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-00adf4a6-960a-40f5-a3ab-a798907e6e52-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-00adf4a6-960a-40f5-a3ab-a798907e6e52-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=173,cinder:SELECT=166,cinder:INSERT=42,cinder:DELETE=19 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Performing cascade delete. {{(pid=87505) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-3107d899-4a56-479d-841c-056e60fc513d-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-3107d899-4a56-479d-841c-056e60fc513d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-00adf4a6-960a-40f5-a3ab-a798907e6e52" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-00adf4a6-960a-40f5-a3ab-a798907e6e52" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-3107d899-4a56-479d-841c-056e60fc513d" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-3107d899-4a56-479d-841c-056e60fc513d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Deleting offline snapshot 3107d899-4a56-479d-841c-056e60fc513d of volume 00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] snapshot_file for this snap is: volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf23f29-fbc2-4804-88e3-633aaa3b2105]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:13 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d
Sep 08 16:38:13 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:13 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Flow 'volume_create_manager' (a29e23dd-8020-435a-8b85-c962bc46ff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4a7dce-d1f1-4ebe-a78c-7bd3a72780cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d" returned: 0 in 0.493s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00adf4a6-960a-40f5-a3ab-a798907e6e52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4a7dce-d1f1-4ebe-a78c-7bd3a72780cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1255262655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87593a1-ba0f-4c89-802d-d6de08105af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6427b62ddc47497da412646e72df39ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:14Z,use_quota=True,user_id='776991eda52b4887bdffed2a3198854f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680b9cb9-a3c7-44a1-81da-e4872f76f2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680b9cb9-a3c7-44a1-81da-e4872f76f2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c91b4b7-ac31-49f1-bb45-b44a83f9c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c91b4b7-ac31-49f1-bb45-b44a83f9c02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87593a1-ba0f-4c89-802d-d6de08105af9', 'volume_name': 'volume-d87593a1-ba0f-4c89-802d-d6de08105af9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fc7217-93e5-4e6a-b608-c8ac4c98eb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1fc7217-93e5-4e6a-b608-c8ac4c98eb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df290311-4843-4e19-b00c-282b6f4a8d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Volume d87593a1-ba0f-4c89-802d-d6de08105af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87593a1-ba0f-4c89-802d-d6de08105af9', 'volume_size': 1}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1255262655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87593a1-ba0f-4c89-802d-d6de08105af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6427b62ddc47497da412646e72df39ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:14Z,use_quota=True,user_id='776991eda52b4887bdffed2a3198854f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Creating volume d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:14 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae7021-e471-4cf0-9ce9-bb6d95685fcc]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:14 devstack sudo[96473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 1073741824
Sep 08 16:38:14 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:14 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52
Sep 08 16:38:14 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:14 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 1073741824" returned: 0 in 0.487s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:14 devstack sudo[96483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9
Sep 08 16:38:14 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:14 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52" returned: 0 in 0.644s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:14 devstack sudo[96487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d
Sep 08 16:38:14 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:14 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df290311-4843-4e19-b00c-282b6f4a8d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87593a1-ba0f-4c89-802d-d6de08105af9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20968e3-d56a-403c-b44b-96a066433b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Volume volume-d87593a1-ba0f-4c89-802d-d6de08105af9 (d87593a1-ba0f-4c89-802d-d6de08105af9): created successfully
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20968e3-d56a-403c-b44b-96a066433b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Flow 'volume_create_manager' (a29e23dd-8020-435a-8b85-c962bc46ff61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-bb0ec579-a359-4a37-a2bc-747b890352d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Created volume successfully.
Sep 08 16:38:15 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d" returned: 0 in 0.520s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:15 devstack sudo[96513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d
Sep 08 16:38:15 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:15 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52.3107d899-4a56-479d-841c-056e60fc513d" returned: 0 in 0.271s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-3107d899-4a56-479d-841c-056e60fc513d" released by "_delete_snapshot" :: held 2.093s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-00adf4a6-960a-40f5-a3ab-a798907e6e52" released by "delete_snapshot" :: held 2.126s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Created reservations ['40296cab-17e7-472f-869c-daa50a079093', 'c3e70192-fe53-475f-b0e2-0cd822bb061d', '2ffac89a-4d60-49d9-b44b-96c338cc9052', 'b045fd15-c53b-4c6e-a012-00728ef80d44'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Delete snapshot completed successfully.
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-3107d899-4a56-479d-841c-056e60fc513d-delete_snapshot" released by "delete_snapshot" :: held 2.323s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Snapshots deleted, issuing volume delete {{(pid=87505) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-00adf4a6-960a-40f5-a3ab-a798907e6e52" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-00adf4a6-960a-40f5-a3ab-a798907e6e52" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb59355-62da-45ad-a9f3-d8df9e7d5292]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:15 devstack sudo[96516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52
Sep 08 16:38:15 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:16 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52" returned: 0 in 0.448s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:16 devstack sudo[96522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52
Sep 08 16:38:16 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Creating offline snapshot f5b10df0-4daa-42af-91f2-6690ad5acb20 of volume d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37baa8a-b30d-41cd-8b36-174295629fe2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:16 devstack sudo[96524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9
Sep 08 16:38:16 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:16 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-00adf4a6-960a-40f5-a3ab-a798907e6e52" returned: 0 in 0.282s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-00adf4a6-960a-40f5-a3ab-a798907e6e52" released by "delete_volume" :: held 0.803s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Created reservations ['4a74fdb4-0ce2-4fb4-a986-dec7e9255466', 'a9e57683-4226-45f4-bc87-64d4811e9dd5', 'd5a01efd-e2b2-4974-9dfa-d67a6217bd26', '11f88524-c874-4210-9adc-fd4856d83ca2'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:16 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9" returned: 0 in 0.383s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:16 devstack sudo[96530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 1G
Sep 08 16:38:16 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:16 devstack sudo[96532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:16 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:16 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Deleted volume successfully.
Sep 08 16:38:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac450e3f-eabc-4821-9ac6-973f121de62a tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-00adf4a6-960a-40f5-a3ab-a798907e6e52-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:17 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 1G" returned: 0 in 0.454s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87593a1-ba0f-4c89-802d-d6de08105af9 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:17 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87593a1-ba0f-4c89-802d-d6de08105af9 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20
Sep 08 16:38:17 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:17 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87593a1-ba0f-4c89-802d-d6de08105af9 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20" returned: 0 in 0.320s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:17 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 is being set with open permissions: ugo+rw
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:17 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20
Sep 08 16:38:17 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:17 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20" returned: 0 in 0.250s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:17 devstack sudo[96549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.info
Sep 08 16:38:17 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-a3267d7d-4489-43a3-820d-3393704ed0a9-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-a3267d7d-4489-43a3-820d-3393704ed0a9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "cinder-quobyte-a3267d7d-4489-43a3-820d-3393704ed0a9" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-a3267d7d-4489-43a3-820d-3393704ed0a9" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[90946f41-09c2-47df-8188-b4081977ffe7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:18 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.info" returned: 0 in 0.288s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:18 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.info is being set with open permissions: ugo+rw
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:18 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.info
Sep 08 16:38:18 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:18 devstack sudo[96552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9
Sep 08 16:38:18 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:18 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.info" returned: 0 in 0.273s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.075s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8e2e0230-f2a9-442e-af20-1a87557367e1 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Create snapshot completed successfully
Sep 08 16:38:18 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9" returned: 0 in 0.405s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:18 devstack sudo[96560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9
Sep 08 16:38:18 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:18 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a3267d7d-4489-43a3-820d-3393704ed0a9" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-quobyte-a3267d7d-4489-43a3-820d-3393704ed0a9" released by "delete_volume" :: held 0.695s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Created reservations ['d374be2d-6475-4b2c-884f-decba2e9df67', '22a2f88e-60ff-4307-8c79-aead71288c54', '0e9f7d1e-0261-4735-9fd0-910237f672da', '7a9c2fd7-1d69-4721-a223-7254169e2ada'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:18 devstack sudo[96563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:18 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:19 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.269s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Deleted volume successfully.
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b7b0aef2-bd59-4408-93e8-690784e49834 tempest-VolumesDeleteCascade-953838763 None] Lock "cinder-a3267d7d-4489-43a3-820d-3393704ed0a9-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "cinder-f5b10df0-4daa-42af-91f2-6690ad5acb20-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-f5b10df0-4daa-42af-91f2-6690ad5acb20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "cinder-quobyte-d87593a1-ba0f-4c89-802d-d6de08105af9" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-quobyte-d87593a1-ba0f-4c89-802d-d6de08105af9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "cinder-quobyte-f5b10df0-4daa-42af-91f2-6690ad5acb20" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-quobyte-f5b10df0-4daa-42af-91f2-6690ad5acb20" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Deleting offline snapshot f5b10df0-4daa-42af-91f2-6690ad5acb20 of volume d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] snapshot_file for this snap is: volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c894712-b170-4c6e-8d37-d150ae4b3d06]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:20 devstack sudo[96566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20
Sep 08 16:38:20 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:20 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20" returned: 0 in 0.440s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87593a1-ba0f-4c89-802d-d6de08105af9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec8c3d-f9c7-4d42-99e0-8910bb7bb940]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:20 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9
Sep 08 16:38:20 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:20 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9" returned: 0 in 0.380s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:20 devstack sudo[96576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20
Sep 08 16:38:20 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:21 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20" returned: 0 in 0.414s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:21 devstack sudo[96582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20
Sep 08 16:38:21 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:21 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9.f5b10df0-4daa-42af-91f2-6690ad5acb20" returned: 0 in 0.364s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-quobyte-f5b10df0-4daa-42af-91f2-6690ad5acb20" released by "_delete_snapshot" :: held 1.767s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-quobyte-d87593a1-ba0f-4c89-802d-d6de08105af9" released by "delete_snapshot" :: held 1.795s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:21 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Created reservations ['febd8692-dfe6-48b1-95a0-224305aaf210', '9e549a6a-5b89-4518-ae32-17012736e59c', '2ef10438-b046-4c77-add1-e6919847b438', '58aa8703-1270-403a-8110-2988e0efd4ca'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Delete snapshot completed successfully.
Sep 08 16:38:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-129b42fd-ed11-4966-8592-f3bc5000a716 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-f5b10df0-4daa-42af-91f2-6690ad5acb20-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "cinder-d87593a1-ba0f-4c89-802d-d6de08105af9-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-d87593a1-ba0f-4c89-802d-d6de08105af9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "cinder-quobyte-d87593a1-ba0f-4c89-802d-d6de08105af9" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-quobyte-d87593a1-ba0f-4c89-802d-d6de08105af9" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:22 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[df256109-531d-4699-964a-58fe7d825605]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:22 devstack sudo[96585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9
Sep 08 16:38:22 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:23 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9" returned: 0 in 0.677s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:23 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9
Sep 08 16:38:23 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:23 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d87593a1-ba0f-4c89-802d-d6de08105af9" returned: 0 in 0.321s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-quobyte-d87593a1-ba0f-4c89-802d-d6de08105af9" released by "delete_volume" :: held 1.092s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Created reservations ['d5fd21a8-15d1-48b9-b122-02c7292ad654', '6b93d8a4-7402-4b79-8456-f1f5109190ef', 'fa0ecafe-1a9e-4a02-848b-5cd9423a6a2f', '290b18fd-ba7c-4751-bd3d-6596df250dc1'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:23 devstack sudo[96594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:23 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:24 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.332s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:24 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Deleted volume successfully.
Sep 08 16:38:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac7e0a1a-6290-4455-8930-ba922d40ae97 tempest-VolumeSnapshotQuotasNegativeTestJSON-632614251 None] Lock "cinder-d87593a1-ba0f-4c89-802d-d6de08105af9-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Flow 'volume_create_manager' (8871685a-6fd7-4e7c-b470-28ff8f2686e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a3fa74-807f-4ffe-9742-7826d4f03d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a3fa74-807f-4ffe-9742-7826d4f03d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1390877301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b1bb27-eb93-495b-a3d0-d4a083a19f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c986c0c850474e53b1b383fb9f344dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:27Z,use_quota=True,user_id='1e8ebd8aeefb4e91bbff84590115882d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d98743-3729-47ae-81b2-4e2fb6112adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d98743-3729-47ae-81b2-4e2fb6112adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf470f0-af09-4331-a7d6-6ab0204cf86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf470f0-af09-4331-a7d6-6ab0204cf86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b1bb27-eb93-495b-a3d0-d4a083a19f13', 'volume_name': 'volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af58c39b-dbcf-4456-9f09-ad38b38ff33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af58c39b-dbcf-4456-9f09-ad38b38ff33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d780613-0c5b-40bc-9c0b-b01a439879e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:27 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Volume 50b1bb27-eb93-495b-a3d0-d4a083a19f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13', 'volume_size': 1}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1390877301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b1bb27-eb93-495b-a3d0-d4a083a19f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c986c0c850474e53b1b383fb9f344dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:27Z,use_quota=True,user_id='1e8ebd8aeefb4e91bbff84590115882d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Creating volume 50b1bb27-eb93-495b-a3d0-d4a083a19f13 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:27 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:27 devstack sudo[96597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13 1073741824
Sep 08 16:38:27 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:27 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13 1073741824" returned: 0 in 0.510s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:27 devstack sudo[96603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13
Sep 08 16:38:27 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:28 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13" returned: 0 in 0.292s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d780613-0c5b-40bc-9c0b-b01a439879e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a58272c-af41-4aa4-8e51-8f7c1e703649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:28 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Volume volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13 (50b1bb27-eb93-495b-a3d0-d4a083a19f13): created successfully
Sep 08 16:38:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a58272c-af41-4aa4-8e51-8f7c1e703649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Flow 'volume_create_manager' (8871685a-6fd7-4e7c-b470-28ff8f2686e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:28 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-72fbcffb-67b7-430b-9823-14ca5d8cf72b tempest-VolumesTransfersTest-1684176341 None] Created volume successfully.
Sep 08 16:38:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-44ab9b7a-914e-4430-967c-54be13ec8555 tempest-VolumesTransfersTest-1978989206 None] Transfer volume completed successfully.
Sep 08 16:38:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Acquiring lock "cinder-50b1bb27-eb93-495b-a3d0-d4a083a19f13-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Lock "cinder-50b1bb27-eb93-495b-a3d0-d4a083a19f13-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Acquiring lock "cinder-quobyte-50b1bb27-eb93-495b-a3d0-d4a083a19f13" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Lock "cinder-quobyte-50b1bb27-eb93-495b-a3d0-d4a083a19f13" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b07891c-b897-4203-bdbd-c35c5def48a0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:31 devstack sudo[96638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13
Sep 08 16:38:31 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:32 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13" returned: 0 in 0.548s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:32 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13
Sep 08 16:38:32 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:32 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b1bb27-eb93-495b-a3d0-d4a083a19f13" returned: 0 in 0.388s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Lock "cinder-quobyte-50b1bb27-eb93-495b-a3d0-d4a083a19f13" released by "delete_volume" :: held 1.007s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Created reservations ['53175694-8f02-4b50-85ef-5894f9312d61', '62f7f791-b46f-4559-8771-aaa1003a4318', '0cb691c7-8eeb-4369-8b5b-5d7ec46ea803', 'a1a48cea-50b4-42ea-aa11-c01a603a6c1e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:32 devstack sudo[96647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:32 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:33 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.385s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:33 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:33 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Deleted volume successfully.
Sep 08 16:38:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f22b82cc-b25d-403a-95f3-36e6997a36ca tempest-VolumesTransfersTest-465199062 None] Lock "cinder-50b1bb27-eb93-495b-a3d0-d4a083a19f13-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Flow 'volume_create_manager' (c4e80b7a-be36-42e3-b210-f8b3ffb300c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed66dc04-c62b-4355-8080-dda66ecefd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed66dc04-c62b-4355-8080-dda66ecefd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-589915904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683cb505-3357-4bae-b0a5-7434df71dd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c986c0c850474e53b1b383fb9f344dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:34Z,use_quota=True,user_id='1e8ebd8aeefb4e91bbff84590115882d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d54b56-1db0-440f-8b35-3eeabf861ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d54b56-1db0-440f-8b35-3eeabf861ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1655dcb4-906d-41fa-94d3-71c9eff1c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1655dcb4-906d-41fa-94d3-71c9eff1c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683cb505-3357-4bae-b0a5-7434df71dd34', 'volume_name': 'volume-683cb505-3357-4bae-b0a5-7434df71dd34', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d705f556-78e2-4f1f-9497-08d9bdee3336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d705f556-78e2-4f1f-9497-08d9bdee3336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892cfd52-e34d-4932-addb-77a15bfec7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Volume 683cb505-3357-4bae-b0a5-7434df71dd34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683cb505-3357-4bae-b0a5-7434df71dd34', 'volume_size': 1}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-589915904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683cb505-3357-4bae-b0a5-7434df71dd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c986c0c850474e53b1b383fb9f344dc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:34Z,use_quota=True,user_id='1e8ebd8aeefb4e91bbff84590115882d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Creating volume 683cb505-3357-4bae-b0a5-7434df71dd34 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:34 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:34 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34 1073741824
Sep 08 16:38:34 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:35 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34 1073741824" returned: 0 in 0.679s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:35 devstack sudo[96665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34
Sep 08 16:38:35 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:35 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34" returned: 0 in 0.413s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892cfd52-e34d-4932-addb-77a15bfec7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683cb505-3357-4bae-b0a5-7434df71dd34', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843c177d-864a-4c40-bca9-a1bd6ae09eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Volume volume-683cb505-3357-4bae-b0a5-7434df71dd34 (683cb505-3357-4bae-b0a5-7434df71dd34): created successfully
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843c177d-864a-4c40-bca9-a1bd6ae09eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Flow 'volume_create_manager' (c4e80b7a-be36-42e3-b210-f8b3ffb300c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-43e67324-a4c3-4a63-92da-d524555c5593 tempest-VolumesTransfersTest-1684176341 None] Created volume successfully.
Sep 08 16:38:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Acquiring lock "cinder-683cb505-3357-4bae-b0a5-7434df71dd34-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Lock "cinder-683cb505-3357-4bae-b0a5-7434df71dd34-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Acquiring lock "cinder-quobyte-683cb505-3357-4bae-b0a5-7434df71dd34" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Lock "cinder-quobyte-683cb505-3357-4bae-b0a5-7434df71dd34" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1213714-ea0e-439d-b134-b745b82ef173]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:37 devstack sudo[96668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34
Sep 08 16:38:37 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:37 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34" returned: 0 in 0.478s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:37 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34
Sep 08 16:38:37 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:37 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-683cb505-3357-4bae-b0a5-7434df71dd34" returned: 0 in 0.397s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Lock "cinder-quobyte-683cb505-3357-4bae-b0a5-7434df71dd34" released by "delete_volume" :: held 0.932s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:37 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Created reservations ['a5b9001a-c8c1-4675-be42-54789eecb077', 'd96169d2-2747-43fa-ad66-48bf85423f74', '3ed82cf2-9562-4a35-8b05-c14c094053c2', '6a465833-1e25-4581-85b7-ad6930d63a23'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:38 devstack sudo[96677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:38 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-f55488cc-fccb-4a00-b7ec-b54f2d9d9134 req-bbd898f1-84dd-4f33-96f2-00377c9b0fa7 tempest-AttachVolumeNegativeTest-1876492861 None] Terminate volume connection completed successfully.
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f55488cc-fccb-4a00-b7ec-b54f2d9d9134 req-bbd898f1-84dd-4f33-96f2-00377c9b0fa7 tempest-AttachVolumeNegativeTest-1876492861 None] Deleting attachment 67260c74-e639-42b8-8bac-af1775c1637b. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:38:38 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.461s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Deleted volume successfully.
Sep 08 16:38:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bb21ab6d-b9dd-45cc-a025-ff4ad3633904 tempest-VolumesTransfersTest-465199062 None] Lock "cinder-683cb505-3357-4bae-b0a5-7434df71dd34-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Flow 'volume_create_manager' (4f2d9156-f7e0-4ade-9d8f-362ab6c2624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f4b74-ffc6-446b-9197-80507efdef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f4b74-ffc6-446b-9197-80507efdef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1415166504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a5d562-779d-4245-a7af-02c73989c0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f94aff67644c5186fe23536cacd103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:45Z,use_quota=True,user_id='c47ec9b3974a48ca9059f94c53d6627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2159e4e5-687c-4fda-a642-778aae03ed49),volume_type_id=2159e4e5-687c-4fda-a642-778aae03ed49)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7555d3a3-5cf8-4bf1-a6d8-45cf0b306acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7555d3a3-5cf8-4bf1-a6d8-45cf0b306acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b9e5ef-e893-402a-b92c-9690529143aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b9e5ef-e893-402a-b92c-9690529143aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a5d562-779d-4245-a7af-02c73989c0ca', 'volume_name': 'volume-d8a5d562-779d-4245-a7af-02c73989c0ca', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03499aa-0597-4701-b4e1-dd542d33a865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03499aa-0597-4701-b4e1-dd542d33a865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd63510-d9ee-47fa-a284-0b5071a6c5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:44 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume d8a5d562-779d-4245-a7af-02c73989c0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a5d562-779d-4245-a7af-02c73989c0ca', 'volume_size': 1}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1415166504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8a5d562-779d-4245-a7af-02c73989c0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f94aff67644c5186fe23536cacd103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:45Z,use_quota=True,user_id='c47ec9b3974a48ca9059f94c53d6627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2159e4e5-687c-4fda-a642-778aae03ed49),volume_type_id=2159e4e5-687c-4fda-a642-778aae03ed49)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Creating volume d8a5d562-779d-4245-a7af-02c73989c0ca {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:44 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:44 devstack sudo[96709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca 1073741824
Sep 08 16:38:44 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Flow 'volume_create_manager' (ae6bf797-96cf-440f-a67f-228ebd7c6808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b760c77e-0f09-4d0f-936a-a66acbe41a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b760c77e-0f09-4d0f-936a-a66acbe41a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1805326600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9feca0-4892-4d26-b206-39db38ba6bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f94aff67644c5186fe23536cacd103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:45Z,use_quota=True,user_id='c47ec9b3974a48ca9059f94c53d6627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b132dd7c-0fca-4e97-ba13-352d3fa89d25),volume_type_id=b132dd7c-0fca-4e97-ba13-352d3fa89d25)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3a973f-08bc-4376-9fa2-405944575099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3a973f-08bc-4376-9fa2-405944575099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b708a4dc-4f3b-4012-bb88-901a4c6f9530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b708a4dc-4f3b-4012-bb88-901a4c6f9530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9feca0-4892-4d26-b206-39db38ba6bd2', 'volume_name': 'volume-4b9feca0-4892-4d26-b206-39db38ba6bd2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2370c504-ea0b-489a-bda4-7588f1c93c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2370c504-ea0b-489a-bda4-7588f1c93c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51197d16-669f-4d83-8633-dfe9ffccbc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:45 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume 4b9feca0-4892-4d26-b206-39db38ba6bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9feca0-4892-4d26-b206-39db38ba6bd2', 'volume_size': 1}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:45 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca 1073741824" returned: 0 in 0.698s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:45 devstack sudo[96715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca
Sep 08 16:38:45 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:45 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca" returned: 0 in 0.301s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.473s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1805326600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9feca0-4892-4d26-b206-39db38ba6bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f94aff67644c5186fe23536cacd103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:45Z,use_quota=True,user_id='c47ec9b3974a48ca9059f94c53d6627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b132dd7c-0fca-4e97-ba13-352d3fa89d25),volume_type_id=b132dd7c-0fca-4e97-ba13-352d3fa89d25)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Creating volume 4b9feca0-4892-4d26-b206-39db38ba6bd2 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:45 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:45 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2 1073741824
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd63510-d9ee-47fa-a284-0b5071a6c5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a5d562-779d-4245-a7af-02c73989c0ca', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:45 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb6b1be-34ea-42c0-8dd3-8dcf2f301de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:46 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume volume-d8a5d562-779d-4245-a7af-02c73989c0ca (d8a5d562-779d-4245-a7af-02c73989c0ca): created successfully
Sep 08 16:38:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb6b1be-34ea-42c0-8dd3-8dcf2f301de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Flow 'volume_create_manager' (4f2d9156-f7e0-4ade-9d8f-362ab6c2624c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:46 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e30655ae-193d-4a29-b01f-a569594449cf tempest-TestInstancesWithCinderVolumes-1094956448 None] Created volume successfully.
Sep 08 16:38:46 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2 1073741824" returned: 0 in 0.772s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:46 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2
Sep 08 16:38:46 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:47 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2" returned: 0 in 0.392s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51197d16-669f-4d83-8633-dfe9ffccbc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9feca0-4892-4d26-b206-39db38ba6bd2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2322ce-bc01-4059-8062-79b17c4517fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:47 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume volume-4b9feca0-4892-4d26-b206-39db38ba6bd2 (4b9feca0-4892-4d26-b206-39db38ba6bd2): created successfully
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2322ce-bc01-4059-8062-79b17c4517fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Flow 'volume_create_manager' (ae6bf797-96cf-440f-a67f-228ebd7c6808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:47 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-46dc5c32-19ae-4f33-88fe-afada2b92e44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Created volume successfully.
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Flow 'volume_create_manager' (d46da008-db55-48d1-9c3f-8b3a3bbc69ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e077eb-7547-4072-b36d-7639b69f9478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e077eb-7547-4072-b36d-7639b69f9478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-571687413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073baac3-a049-405e-b6f7-6a97ac9ce22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f94aff67644c5186fe23536cacd103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:47Z,use_quota=True,user_id='c47ec9b3974a48ca9059f94c53d6627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0edbef02-f6af-4f6b-8726-6671355e08e7),volume_type_id=0edbef02-f6af-4f6b-8726-6671355e08e7)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c95e1b6-3656-410a-b1fd-5f57c9d50eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c95e1b6-3656-410a-b1fd-5f57c9d50eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98941ef2-d357-4c35-a639-0e59cd2459e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:47 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:38:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98941ef2-d357-4c35-a639-0e59cd2459e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '073baac3-a049-405e-b6f7-6a97ac9ce22a', 'volume_name': 'volume-073baac3-a049-405e-b6f7-6a97ac9ce22a', 'volume_size': 1, 'image_id': 'c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--934818776', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '82f94aff67644c5186fe23536cacd103', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'created_at': datetime.datetime(2026, 9, 8, 14, 38, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 38, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34365fb7d0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8be5c2-1df2-4850-af0d-408cd1c0b686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8be5c2-1df2-4850-af0d-408cd1c0b686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453f4d46-e125-4735-a4d2-ca6ee95d9efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume 073baac3-a049-405e-b6f7-6a97ac9ce22a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-073baac3-a049-405e-b6f7-6a97ac9ce22a', 'volume_size': 1, 'image_id': 'c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--934818776', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '82f94aff67644c5186fe23536cacd103', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'created_at': datetime.datetime(2026, 9, 8, 14, 38, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 38, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34365fb7d0>}
Sep 08 16:38:48 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Trying to clone 073baac3-a049-405e-b6f7-6a97ac9ce22a from image c5004837-3132-41a2-9eb3-697fb3c9c0a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Flow 'volume_create_manager' (99cfe41a-0858-43c7-b02f-f1d83a1e8a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183f00f1-6d26-4f58-8c47-2982a98c6742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183f00f1-6d26-4f58-8c47-2982a98c6742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-93631689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8723d71209d44b799e7eba22afa64957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:51Z,use_quota=True,user_id='991fef1161bb40749cc6ddd1bf2e789d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5841b03-a2ac-454c-b677-9ee3b263e67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5841b03-a2ac-454c-b677-9ee3b263e67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a53b4ca-c353-470a-af81-f3ddbe750df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a53b4ca-c353-470a-af81-f3ddbe750df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d', 'volume_name': 'volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f52cef9-b205-4a10-8df7-c1ba4bb725e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f52cef9-b205-4a10-8df7-c1ba4bb725e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d17199-33b5-46eb-8cfb-ce0474b7e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:50 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Volume c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d', 'volume_size': 1}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-93631689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8723d71209d44b799e7eba22afa64957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:51Z,use_quota=True,user_id='991fef1161bb40749cc6ddd1bf2e789d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Creating volume c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:50 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:50 devstack sudo[96780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d 1073741824
Sep 08 16:38:50 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:51 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d 1073741824" returned: 0 in 0.638s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:51 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d
Sep 08 16:38:51 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:51 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d" returned: 0 in 0.293s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d17199-33b5-46eb-8cfb-ce0474b7e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd5e371-d768-4b83-b51b-d0c114ccebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:51 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Volume volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d (c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d): created successfully
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd5e371-d768-4b83-b51b-d0c114ccebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Flow 'volume_create_manager' (99cfe41a-0858-43c7-b02f-f1d83a1e8a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-898dfc9d-1ee7-4ac8-8fb7-e8ae930f46f9 tempest-VolumesTransfersV355Test-40432164 None] Created volume successfully.
Sep 08 16:38:52 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD, size 20.69 MB, duration 4.61 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:38:52 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Image download 20.69 MB at 4.49 MB/s
Sep 08 16:38:52 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8609d262-7bfe-4eea-8e8d-927461b8cac7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:52 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD
Sep 08 16:38:52 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:53 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Temporary image c5004837-3132-41a2-9eb3-697fb3c9c0a6 is fetched for user c47ec9b3974a48ca9059f94c53d6627c. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed01d52-dd4d-473d-b38b-bbff638dcd77]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:53 devstack sudo[96799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD
Sep 08 16:38:53 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:53 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-571687413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073baac3-a049-405e-b6f7-6a97ac9ce22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82f94aff67644c5186fe23536cacd103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:47Z,use_quota=True,user_id='c47ec9b3974a48ca9059f94c53d6627c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0edbef02-f6af-4f6b-8726-6671355e08e7),volume_type_id=0edbef02-f6af-4f6b-8726-6671355e08e7)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Creating volume 073baac3-a049-405e-b6f7-6a97ac9ce22a {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:54 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:54 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a 1073741824
Sep 08 16:38:54 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-83776b82-f62a-4d5b-bb82-335da5590edf tempest-VolumesTransfersV355Test-1395264898 None] Transfer volume completed successfully.
Sep 08 16:38:55 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a 1073741824" returned: 0 in 1.117s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:55 devstack sudo[96876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a
Sep 08 16:38:55 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Acquiring lock "cinder-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Acquiring lock "cinder-quobyte-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-quobyte-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:38:55 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a" returned: 0 in 0.555s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cc0b57-9253-42e0-b65f-4eed161531de]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:55 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Attempting download of c5004837-3132-41a2-9eb3-697fb3c9c0a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'metadata': {}}])) to volume 073baac3-a049-405e-b6f7-6a97ac9ce22a. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:38:55 devstack sudo[96881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d
Sep 08 16:38:55 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd87a3a-95e2-4252-b7f7-19673bd5c58d]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5004837-3132-41a2-9eb3-697fb3c9c0a6_hfetciym {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:56 devstack sudo[96883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5004837-3132-41a2-9eb3-697fb3c9c0a6_hfetciym
Sep 08 16:38:56 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:56 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d" returned: 0 in 0.633s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:56 devstack sudo[96889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d
Sep 08 16:38:56 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:56 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:56 devstack sudo[96893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5004837-3132-41a2-9eb3-697fb3c9c0a6_hfetciym" returned: 0 in 0.421s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5004837-3132-41a2-9eb3-697fb3c9c0a6_hfetciym {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:56 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:56 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d" returned: 0 in 0.413s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-quobyte-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d" released by "delete_volume" :: held 1.161s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:56 devstack sudo[96895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5004837-3132-41a2-9eb3-697fb3c9c0a6_hfetciym
Sep 08 16:38:56 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:56 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.375s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Created reservations ['4c2f5a9e-5c93-4254-8d52-3b84aead7a94', '4a13f1e6-0ea4-4afa-ab41-b1c7b7d11c4f', '5b4b7998-15f0-467d-965d-e88457d27457', '045de559-ae87-4336-b4e9-cc442b427908'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:57 devstack sudo[96899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:38:57 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:57 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5004837-3132-41a2-9eb3-697fb3c9c0a6_hfetciym" returned: 1 in 0.654s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5004837-3132-41a2-9eb3-697fb3c9c0a6_hfetciym' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff21b96-a822-43d5-8e2d-909b27ac08c1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:57 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD
Sep 08 16:38:57 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:57 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.508s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:38:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Deleted volume successfully.
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8baccc91-ccd1-4bce-bbdc-abfece277e61 tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-c7d44c29-92a8-49cd-b0c2-ac2b5e7e981d-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:38:57 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] c5004837-3132-41a2-9eb3-697fb3c9c0a6 was qcow2, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:38:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:57 devstack sudo[96909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a
Sep 08 16:38:57 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Flow 'volume_create_manager' (8ff4846f-8252-4524-84bd-5638812a20da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fe37a1-e958-4223-b9ad-b47bdf0d9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fe37a1-e958-4223-b9ad-b47bdf0d9695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-707231457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00c988f-a127-4495-aec7-8e6d3e8e1fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8723d71209d44b799e7eba22afa64957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:59Z,use_quota=True,user_id='991fef1161bb40749cc6ddd1bf2e789d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb0efd8-1a4e-4f91-a94e-53468c1f02c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb0efd8-1a4e-4f91-a94e-53468c1f02c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2f0ccb-fe9e-433c-9d42-30690bc71ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2f0ccb-fe9e-433c-9d42-30690bc71ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00c988f-a127-4495-aec7-8e6d3e8e1fe8', 'volume_name': 'volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b1584-21c4-44dc-8a7a-0198749456e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b1584-21c4-44dc-8a7a-0198749456e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1415fbf3-ebca-4ea9-92d3-961cc722f37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:38:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Volume e00c988f-a127-4495-aec7-8e6d3e8e1fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8', 'volume_size': 1}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-707231457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00c988f-a127-4495-aec7-8e6d3e8e1fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8723d71209d44b799e7eba22afa64957',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:38:59Z,use_quota=True,user_id='991fef1161bb40749cc6ddd1bf2e789d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Creating volume e00c988f-a127-4495-aec7-8e6d3e8e1fe8 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:38:59 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:38:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:38:59 devstack sudo[96916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8 1073741824
Sep 08 16:38:59 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:00 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8 1073741824" returned: 0 in 0.662s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:00 devstack sudo[96922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8
Sep 08 16:39:00 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:00 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8" returned: 0 in 0.388s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1415fbf3-ebca-4ea9-92d3-961cc722f37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bd06e9-18cb-4398-8522-c56b547277c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:00 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Volume volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8 (e00c988f-a127-4495-aec7-8e6d3e8e1fe8): created successfully
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bd06e9-18cb-4398-8522-c56b547277c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Flow 'volume_create_manager' (8ff4846f-8252-4524-84bd-5638812a20da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8865c9a4-3262-4866-b0dc-557573923104 tempest-VolumesTransfersV355Test-40432164 None] Created volume successfully.
Sep 08 16:39:00 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a" returned: 0 in 2.810s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5004837-3132-41a2-9eb3-697fb3c9c0a6_pvv59imwdevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:39:00 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Converted 112.00 MB image at 39.83 MB/s
Sep 08 16:39:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:00 devstack sudo[96926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a 1G
Sep 08 16:39:00 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:01 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a 1G" returned: 0 in 0.359s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Downloaded image c5004837-3132-41a2-9eb3-697fb3c9c0a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'metadata': {}}])) to volume 073baac3-a049-405e-b6f7-6a97ac9ce22a successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Temporary image c5004837-3132-41a2-9eb3-697fb3c9c0a6 for user c47ec9b3974a48ca9059f94c53d6627c is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Marking volume 073baac3-a049-405e-b6f7-6a97ac9ce22a as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Copying metadata from image c5004837-3132-41a2-9eb3-697fb3c9c0a6 to 073baac3-a049-405e-b6f7-6a97ac9ce22a. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Creating volume glance metadata for volume 073baac3-a049-405e-b6f7-6a97ac9ce22a backed by image c5004837-3132-41a2-9eb3-697fb3c9c0a6 with: {'image_id': 'c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'image_name': 'tempest-scenario-img--934818776', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453f4d46-e125-4735-a4d2-ca6ee95d9efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073baac3-a049-405e-b6f7-6a97ac9ce22a', 'volume_size': 1, 'image_id': 'c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--934818776', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '82f94aff67644c5186fe23536cacd103', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5004837-3132-41a2-9eb3-697fb3c9c0a6', 'created_at': datetime.datetime(2026, 9, 8, 14, 38, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 38, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5004837-3132-41a2-9eb3-697fb3c9c0a6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34365fb7d0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66101b61-2d93-49a0-8863-3c3785257cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:01 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Volume volume-073baac3-a049-405e-b6f7-6a97ac9ce22a (073baac3-a049-405e-b6f7-6a97ac9ce22a): created successfully
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66101b61-2d93-49a0-8863-3c3785257cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Flow 'volume_create_manager' (d46da008-db55-48d1-9c3f-8b3a3bbc69ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d4dafc4a-e224-40f2-b90a-a96abef4f416 tempest-TestInstancesWithCinderVolumes-1094956448 None] Created volume successfully.
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Acquiring lock "cinder-e00c988f-a127-4495-aec7-8e6d3e8e1fe8-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-e00c988f-a127-4495-aec7-8e6d3e8e1fe8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Acquiring lock "cinder-quobyte-e00c988f-a127-4495-aec7-8e6d3e8e1fe8" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-quobyte-e00c988f-a127-4495-aec7-8e6d3e8e1fe8" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdf029-fbde-44a7-b10b-fe9080369c6b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:02 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8
Sep 08 16:39:02 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:02 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8" returned: 0 in 0.551s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:02 devstack sudo[96938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8
Sep 08 16:39:02 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:02 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e00c988f-a127-4495-aec7-8e6d3e8e1fe8" returned: 0 in 0.306s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-quobyte-e00c988f-a127-4495-aec7-8e6d3e8e1fe8" released by "delete_volume" :: held 0.916s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Created reservations ['fe2b1061-68e8-465c-bbbe-0dad91c47f34', 'cd703b18-9f0a-457d-8476-6ca7dffc8d4b', 'd0119641-8553-44f5-997c-8b190483016e', '911c1105-5a97-4f4a-ba79-dbae556ed265'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:02 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:02 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:03 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.367s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:03 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Deleted volume successfully.
Sep 08 16:39:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e25ad1f8-9153-4178-8dd4-8629a41d334f tempest-VolumesTransfersV355Test-339706413 None] Lock "cinder-e00c988f-a127-4495-aec7-8e6d3e8e1fe8-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-8ede80f8-670b-47d4-911f-cf21c9269433 req-cc2495d8-9b76-4f65-807b-c329e47b2fbf tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-8ede80f8-670b-47d4-911f-cf21c9269433 req-cc2495d8-9b76-4f65-807b-c329e47b2fbf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-8ede80f8-670b-47d4-911f-cf21c9269433 req-cc2495d8-9b76-4f65-807b-c329e47b2fbf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-8ede80f8-670b-47d4-911f-cf21c9269433 req-cc2495d8-9b76-4f65-807b-c329e47b2fbf tempest-TestInstancesWithCinderVolumes-1094956448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-073baac3-a049-405e-b6f7-6a97ac9ce22a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78736c4f-0b1f-4f68-adab-a69278fc892b', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:39:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-8ede80f8-670b-47d4-911f-cf21c9269433 req-cc2495d8-9b76-4f65-807b-c329e47b2fbf tempest-TestInstancesWithCinderVolumes-1094956448 None] attachment_update completed successfully.
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=85,cinder:INSERT=27,cinder:UPDATE=97,cinder:DELETE=7 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=78,cinder:UPDATE=105,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Flow 'volume_create_manager' (f7e6cdc9-f3b3-4dcf-b02f-9799d8abd6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a423d13-7c59-49b9-8f9b-ad4709f8e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a423d13-7c59-49b9-8f9b-ad4709f8e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1682080516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7438c9-90e9-4f9d-8e66-d4503508b7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bc292e74eb48d1bf41ef319eb7c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:17Z,use_quota=True,user_id='1441c1b3393c438791fc35f98886ecf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7d1276-7d7a-40a5-a2ba-4bf8dba22ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7d1276-7d7a-40a5-a2ba-4bf8dba22ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc8f8c6-e881-4b11-8a44-f5f36cd88fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc8f8c6-e881-4b11-8a44-f5f36cd88fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7438c9-90e9-4f9d-8e66-d4503508b7ac', 'volume_name': 'volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa45a6c7-1c3f-4295-af2a-483b658e2d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa45a6c7-1c3f-4295-af2a-483b658e2d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cc0c6c-94dd-435b-9215-29e8f12b74a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Volume 7a7438c9-90e9-4f9d-8e66-d4503508b7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac', 'volume_size': 1}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1682080516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7438c9-90e9-4f9d-8e66-d4503508b7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bc292e74eb48d1bf41ef319eb7c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:17Z,use_quota=True,user_id='1441c1b3393c438791fc35f98886ecf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Creating volume 7a7438c9-90e9-4f9d-8e66-d4503508b7ac {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:16 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:16 devstack sudo[97425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac 1073741824
Sep 08 16:39:16 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:17 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac 1073741824" returned: 0 in 0.796s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:17 devstack sudo[97432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac
Sep 08 16:39:17 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:18 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac" returned: 0 in 0.368s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cc0c6c-94dd-435b-9215-29e8f12b74a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fd9e33-e8a7-46ec-af1e-0651b7cc9852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:18 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Volume volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac (7a7438c9-90e9-4f9d-8e66-d4503508b7ac): created successfully
Sep 08 16:39:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fd9e33-e8a7-46ec-af1e-0651b7cc9852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Flow 'volume_create_manager' (f7e6cdc9-f3b3-4dcf-b02f-9799d8abd6cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-be5d6683-31ab-4a13-b8e2-71e47c4ad973 tempest-VolumesTransfersV357Test-910833317 None] Created volume successfully.
Sep 08 16:39:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f55f71c0-bf87-4f57-83af-fc4a1fc20144 tempest-VolumesTransfersV357Test-2069300141 None] Transfer volume completed successfully.
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Acquiring lock "cinder-7a7438c9-90e9-4f9d-8e66-d4503508b7ac-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-7a7438c9-90e9-4f9d-8e66-d4503508b7ac-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Acquiring lock "cinder-quobyte-7a7438c9-90e9-4f9d-8e66-d4503508b7ac" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-quobyte-7a7438c9-90e9-4f9d-8e66-d4503508b7ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e372c984-b77f-4f03-9fdc-5ae8392179f4]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:21 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac
Sep 08 16:39:21 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:21 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac" returned: 0 in 0.627s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:21 devstack sudo[97444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac
Sep 08 16:39:21 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:22 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7a7438c9-90e9-4f9d-8e66-d4503508b7ac" returned: 0 in 0.478s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-quobyte-7a7438c9-90e9-4f9d-8e66-d4503508b7ac" released by "delete_volume" :: held 1.193s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Flow 'volume_create_manager' (897f6384-a4e2-4df0-a662-f9c9f5eacae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148c0797-6834-4e1a-a3fd-9ec1ca643195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148c0797-6834-4e1a-a3fd-9ec1ca643195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1524123846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b6e941988a4eb08401b7bbe45ebffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:22Z,use_quota=True,user_id='dd34c8a83ac64ab18890e6ff9f470a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea143e6b-3e4b-443a-b949-6bd27f180568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea143e6b-3e4b-443a-b949-6bd27f180568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bde7a8-9ede-417a-b6ad-f13fd7b65c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bde7a8-9ede-417a-b6ad-f13fd7b65c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab', 'volume_name': 'volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50ece74-49d2-428a-a76b-74721ea1f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50ece74-49d2-428a-a76b-74721ea1f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298a62de-847b-47b4-b548-16eaec37b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:22 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Volume c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab', 'volume_size': 1}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1524123846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b6e941988a4eb08401b7bbe45ebffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:22Z,use_quota=True,user_id='dd34c8a83ac64ab18890e6ff9f470a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Creating volume c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:22 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Created reservations ['4bdaa39a-eab5-49a7-89c0-ad6c3726caef', '0b7d2c31-cd71-4722-866e-e70067c3edb3', '49deb716-049e-4887-8045-ddff782af67c', '700e87cc-f9b7-4699-be24-b92cbae69b5c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:22 devstack sudo[97447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab 1073741824
Sep 08 16:39:22 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:22 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:22 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:23 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.456s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Deleted volume successfully.
Sep 08 16:39:23 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-514996cb-e5d4-4d34-be5a-46cbc8436843 tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-7a7438c9-90e9-4f9d-8e66-d4503508b7ac-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab 1073741824" returned: 0 in 0.772s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:23 devstack sudo[97457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab
Sep 08 16:39:23 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:23 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab" returned: 0 in 0.420s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298a62de-847b-47b4-b548-16eaec37b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe90ab03-2d37-485b-8e7e-2684a1578d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:23 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Volume volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab (c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab): created successfully
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe90ab03-2d37-485b-8e7e-2684a1578d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Flow 'volume_create_manager' (897f6384-a4e2-4df0-a662-f9c9f5eacae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6fb3a7d3-58a6-449c-a33c-4372aab77169 tempest-AttachVolumeNegativeTest-1876492861 None] Created volume successfully.
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Flow 'volume_create_manager' (dd28c107-bc33-45dd-a27b-6e9fa602fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5adffa-0377-468e-a3c3-6200357acc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5adffa-0377-468e-a3c3-6200357acc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-453020020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff214b40-14db-4c81-8258-94a816b2d6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bc292e74eb48d1bf41ef319eb7c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:24Z,use_quota=True,user_id='1441c1b3393c438791fc35f98886ecf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55c194d-560a-4038-9eb9-dc3982f50aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55c194d-560a-4038-9eb9-dc3982f50aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8ad235-ba1b-4bb7-97d8-3f52f3c0bfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8ad235-ba1b-4bb7-97d8-3f52f3c0bfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff214b40-14db-4c81-8258-94a816b2d6bb', 'volume_name': 'volume-ff214b40-14db-4c81-8258-94a816b2d6bb', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e74edaa-81c8-4021-969c-f5d965f6950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e74edaa-81c8-4021-969c-f5d965f6950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250a6aea-eb28-4673-8a68-8b2b6b981506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:24 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Volume ff214b40-14db-4c81-8258-94a816b2d6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff214b40-14db-4c81-8258-94a816b2d6bb', 'volume_size': 1}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-453020020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff214b40-14db-4c81-8258-94a816b2d6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bc292e74eb48d1bf41ef319eb7c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:24Z,use_quota=True,user_id='1441c1b3393c438791fc35f98886ecf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Creating volume ff214b40-14db-4c81-8258-94a816b2d6bb {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:24 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:24 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb 1073741824
Sep 08 16:39:24 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:25 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb 1073741824" returned: 0 in 0.856s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:25 devstack sudo[97473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb
Sep 08 16:39:25 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-6af5d930-a080-4a94-a054-8917b1eb9e63 req-184a5bdf-3570-4608-a6d2-27bbe9604696 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:25 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-6af5d930-a080-4a94-a054-8917b1eb9e63 req-184a5bdf-3570-4608-a6d2-27bbe9604696 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.067s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-6af5d930-a080-4a94-a054-8917b1eb9e63 req-184a5bdf-3570-4608-a6d2-27bbe9604696 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250a6aea-eb28-4673-8a68-8b2b6b981506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff214b40-14db-4c81-8258-94a816b2d6bb', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4941935f-7f48-4411-97f9-b6087deaf680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:25 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Volume volume-ff214b40-14db-4c81-8258-94a816b2d6bb (ff214b40-14db-4c81-8258-94a816b2d6bb): created successfully
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4941935f-7f48-4411-97f9-b6087deaf680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Flow 'volume_create_manager' (dd28c107-bc33-45dd-a27b-6e9fa602fb56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-6af5d930-a080-4a94-a054-8917b1eb9e63 req-184a5bdf-3570-4608-a6d2-27bbe9604696 tempest-AttachVolumeNegativeTest-1876492861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6425986-c153-44a9-b4f0-58ae197aeef5', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:39:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ed9c18fe-b696-40b8-b3a7-7c97fa4aa96e tempest-VolumesTransfersV357Test-910833317 None] Created volume successfully.
Sep 08 16:39:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-6af5d930-a080-4a94-a054-8917b1eb9e63 req-184a5bdf-3570-4608-a6d2-27bbe9604696 tempest-AttachVolumeNegativeTest-1876492861 None] attachment_update completed successfully.
Sep 08 16:39:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Acquiring lock "cinder-ff214b40-14db-4c81-8258-94a816b2d6bb-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-ff214b40-14db-4c81-8258-94a816b2d6bb-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Acquiring lock "cinder-quobyte-ff214b40-14db-4c81-8258-94a816b2d6bb" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-quobyte-ff214b40-14db-4c81-8258-94a816b2d6bb" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dc9dde-051e-4e47-ae25-ff10b9831d8a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:27 devstack sudo[97486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb
Sep 08 16:39:27 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:27 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb" returned: 0 in 0.446s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:27 devstack sudo[97491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb
Sep 08 16:39:27 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:27 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ff214b40-14db-4c81-8258-94a816b2d6bb" returned: 0 in 0.405s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-quobyte-ff214b40-14db-4c81-8258-94a816b2d6bb" released by "delete_volume" :: held 0.930s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Created reservations ['c417575e-cc19-4c40-bcf4-80bb5b394a31', 'bee56ac2-1567-4049-96da-a03dcaa4ff6c', '43bc3bd5-dcee-45bc-af9d-d63afa883160', '6eca7667-aa33-4ba8-bffa-adc05620112e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:28 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:28 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:28 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.563s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:28 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Deleted volume successfully.
Sep 08 16:39:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-59e483f1-bbfa-4bca-9df6-153801d5248e tempest-VolumesTransfersV357Test-326496451 None] Lock "cinder-ff214b40-14db-4c81-8258-94a816b2d6bb-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-00452da3-672f-4356-9308-bbcf65c572c6 req-b614973c-c8d8-4c3a-835b-3d08b42072a4 tempest-AttachVolumeNegativeTest-1876492861 None] Terminate volume connection completed successfully.
Sep 08 16:39:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-00452da3-672f-4356-9308-bbcf65c572c6 req-b614973c-c8d8-4c3a-835b-3d08b42072a4 tempest-AttachVolumeNegativeTest-1876492861 None] Deleting attachment f6425986-c153-44a9-b4f0-58ae197aeef5. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (413efb87-e02f-4e47-a058-720d1983ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ae8b92-eb2c-4b03-a345-bf517f39291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ae8b92-eb2c-4b03-a345-bf517f39291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1792789751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8142520c-93f9-42fe-8d60-35d3af97ae32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:36Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7806f5f-6d75-45e1-b841-bbef374e1fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7806f5f-6d75-45e1-b841-bbef374e1fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01de34e6-6073-4052-8f7b-7d5cfe53a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01de34e6-6073-4052-8f7b-7d5cfe53a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8142520c-93f9-42fe-8d60-35d3af97ae32', 'volume_name': 'volume-8142520c-93f9-42fe-8d60-35d3af97ae32', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d4e281-e078-4de9-bb35-f8b3407f1e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d4e281-e078-4de9-bb35-f8b3407f1e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5d1617-4cec-4f64-9789-38ba75393bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:36 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Volume 8142520c-93f9-42fe-8d60-35d3af97ae32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8142520c-93f9-42fe-8d60-35d3af97ae32', 'volume_size': 1}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1792789751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8142520c-93f9-42fe-8d60-35d3af97ae32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:36Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Creating volume 8142520c-93f9-42fe-8d60-35d3af97ae32 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:36 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:36 devstack sudo[97654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32 1073741824
Sep 08 16:39:36 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:37 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32 1073741824" returned: 0 in 0.564s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:37 devstack sudo[97660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32
Sep 08 16:39:37 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:37 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32" returned: 0 in 0.381s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5d1617-4cec-4f64-9789-38ba75393bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8142520c-93f9-42fe-8d60-35d3af97ae32', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f111323a-2558-4464-835a-22c4322aaaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:37 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Volume volume-8142520c-93f9-42fe-8d60-35d3af97ae32 (8142520c-93f9-42fe-8d60-35d3af97ae32): created successfully
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f111323a-2558-4464-835a-22c4322aaaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (413efb87-e02f-4e47-a058-720d1983ecff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-37cbf072-54c0-4901-b2ea-102b930a5d56 tempest-VolumesActionsTest-869865825 None] Created volume successfully.
Sep 08 16:39:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4312d142-41d8-4b1a-9ea0-3a68a5ba2f82 tempest-VolumesActionsTest-869865825 None] Acquiring lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32" by "attach_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4312d142-41d8-4b1a-9ea0-3a68a5ba2f82 tempest-VolumesActionsTest-869865825 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32" acquired by "attach_volume" :: waited 0.036s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4312d142-41d8-4b1a-9ea0-3a68a5ba2f82 tempest-VolumesActionsTest-869865825 None] Attaching volume 8142520c-93f9-42fe-8d60-35d3af97ae32 to instance 151f3517-7a34-4685-a2b2-51fd5eae54ea at mountpoint /dev/vdb on host None.
Sep 08 16:39:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4312d142-41d8-4b1a-9ea0-3a68a5ba2f82 tempest-VolumesActionsTest-869865825 None] Attach volume completed successfully.
Sep 08 16:39:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4312d142-41d8-4b1a-9ea0-3a68a5ba2f82 tempest-VolumesActionsTest-869865825 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32" released by "attach_volume" :: held 0.161s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-706fb249-f9de-48a2-b82d-c81aa3206df3 tempest-VolumesActionsTest-1582310018 None] Terminate volume connection completed successfully.
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-706fb249-f9de-48a2-b82d-c81aa3206df3 tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-detach_volume" by "detach_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-706fb249-f9de-48a2-b82d-c81aa3206df3 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-706fb249-f9de-48a2-b82d-c81aa3206df3 tempest-VolumesActionsTest-1582310018 None] Detaching volume 8142520c-93f9-42fe-8d60-35d3af97ae32 from instance 151f3517-7a34-4685-a2b2-51fd5eae54ea.
Sep 08 16:39:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-706fb249-f9de-48a2-b82d-c81aa3206df3 tempest-VolumesActionsTest-1582310018 None] Detach volume completed successfully.
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-706fb249-f9de-48a2-b82d-c81aa3206df3 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-detach_volume" released by "detach_volume" :: held 0.168s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Flow 'volume_create_manager' (78e19461-ccac-45e0-b334-dd61e65c1a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787ae3cb-dff2-4c57-b7ac-0c851fde5b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787ae3cb-dff2-4c57-b7ac-0c851fde5b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1145220948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c22516-eea5-4a2b-a13f-da863a291a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d5944e4dfa4c179a8893706fe1f3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:40Z,use_quota=True,user_id='b5c25185d8794ce2a258054ce2d8b79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787a9db7-8f86-46c3-8c26-829ce627dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (787a9db7-8f86-46c3-8c26-829ce627dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506130fe-2d94-4d5a-b174-1e1c2ccb154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506130fe-2d94-4d5a-b174-1e1c2ccb154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c22516-eea5-4a2b-a13f-da863a291a86', 'volume_name': 'volume-f1c22516-eea5-4a2b-a13f-da863a291a86', 'volume_size': 2}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45355241-f43e-458b-9f60-beb4137a5524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45355241-f43e-458b-9f60-beb4137a5524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27457a15-c486-45eb-9226-6853f3b8feaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:40 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Volume f1c22516-eea5-4a2b-a13f-da863a291a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c22516-eea5-4a2b-a13f-da863a291a86', 'volume_size': 2}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1145220948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c22516-eea5-4a2b-a13f-da863a291a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d5944e4dfa4c179a8893706fe1f3d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:40Z,use_quota=True,user_id='b5c25185d8794ce2a258054ce2d8b79c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Creating volume f1c22516-eea5-4a2b-a13f-da863a291a86 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:40 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86 2147483648 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3d0e25f3-14a5-4744-ae71-3cbbe452e559 tempest-VolumesActionsTest-869865825 None] Acquiring lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-detach_volume" by "detach_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3d0e25f3-14a5-4744-ae71-3cbbe452e559 tempest-VolumesActionsTest-869865825 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3d0e25f3-14a5-4744-ae71-3cbbe452e559 tempest-VolumesActionsTest-869865825 None] Volume detach called, but volume not attached.
Sep 08 16:39:40 devstack sudo[97666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86 2147483648
Sep 08 16:39:40 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3d0e25f3-14a5-4744-ae71-3cbbe452e559 tempest-VolumesActionsTest-869865825 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Acquiring lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Acquiring lock "cinder-quobyte-8142520c-93f9-42fe-8d60-35d3af97ae32" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Lock "cinder-quobyte-8142520c-93f9-42fe-8d60-35d3af97ae32" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76f483c-1451-4886-a006-4ea00f23e59e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:41 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32
Sep 08 16:39:41 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:41 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86 2147483648" returned: 0 in 0.894s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:41 devstack sudo[97680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86
Sep 08 16:39:41 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:41 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32" returned: 0 in 0.552s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:41 devstack sudo[97685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32
Sep 08 16:39:41 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:41 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86" returned: 0 in 0.388s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27457a15-c486-45eb-9226-6853f3b8feaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c22516-eea5-4a2b-a13f-da863a291a86', 'volume_size': 2}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26775a8-f2c3-4e32-baf5-c981e8d99277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:41 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Volume volume-f1c22516-eea5-4a2b-a13f-da863a291a86 (f1c22516-eea5-4a2b-a13f-da863a291a86): created successfully
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26775a8-f2c3-4e32-baf5-c981e8d99277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Flow 'volume_create_manager' (78e19461-ccac-45e0-b334-dd61e65c1a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:42 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-34bc45f6-be0d-43eb-99b1-bd2d75297d6f tempest-VolumesCloneNegativeTest-301141095 None] Created volume successfully.
Sep 08 16:39:42 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8142520c-93f9-42fe-8d60-35d3af97ae32" returned: 0 in 0.608s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Lock "cinder-quobyte-8142520c-93f9-42fe-8d60-35d3af97ae32" released by "delete_volume" :: held 1.219s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Created reservations ['458d7cec-04eb-435c-af54-4847998d2137', '58ed5954-3a5d-419e-999f-917b9e46ba75', '5ba45cf0-9cb0-423d-86d8-4b57bebc6b3d', 'ec5c3ee5-fc60-4bbe-9094-34ae7c81eb7c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:42 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:42 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Acquiring lock "cinder-f1c22516-eea5-4a2b-a13f-da863a291a86-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Lock "cinder-f1c22516-eea5-4a2b-a13f-da863a291a86-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Acquiring lock "cinder-quobyte-f1c22516-eea5-4a2b-a13f-da863a291a86" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Lock "cinder-quobyte-f1c22516-eea5-4a2b-a13f-da863a291a86" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b142df0-8cfb-49f7-8af8-87cf6922da90]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:42 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.415s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:42 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:43 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Deleted volume successfully.
Sep 08 16:39:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d931caef-c8fb-44a5-9bca-81928cf78830 tempest-VolumesActionsTest-869865825 None] Lock "cinder-8142520c-93f9-42fe-8d60-35d3af97ae32-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:43 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86
Sep 08 16:39:43 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:43 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86" returned: 0 in 0.558s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:43 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86
Sep 08 16:39:43 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:43 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f1c22516-eea5-4a2b-a13f-da863a291a86" returned: 0 in 0.362s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Lock "cinder-quobyte-f1c22516-eea5-4a2b-a13f-da863a291a86" released by "delete_volume" :: held 0.979s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:43 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Created reservations ['e5d0fcd5-f415-47e6-bea0-5fc068f4ef36', '9bf2581c-e8e4-40d7-8e1e-3bf3502f5208', '9db8cefc-31b3-41be-9d2c-4bd48cce9c2b', '0e71dd4e-a2e4-4902-989e-22cfcbe4d5ae'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:44 devstack sudo[97728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:44 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:44 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.314s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:44 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Deleted volume successfully.
Sep 08 16:39:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4e86fbc6-44bb-4b4e-9223-a24e04052351 tempest-VolumesCloneNegativeTest-301141095 None] Lock "cinder-f1c22516-eea5-4a2b-a13f-da863a291a86-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-4141d71d-fb00-4223-84e8-0a28bf4176b9 req-0ae6bacb-4492-41e1-a46f-5df507685ce4 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-4141d71d-fb00-4223-84e8-0a28bf4176b9 req-0ae6bacb-4492-41e1-a46f-5df507685ce4 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-4141d71d-fb00-4223-84e8-0a28bf4176b9 req-0ae6bacb-4492-41e1-a46f-5df507685ce4 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-4141d71d-fb00-4223-84e8-0a28bf4176b9 req-0ae6bacb-4492-41e1-a46f-5df507685ce4 tempest-TestInstancesWithCinderVolumes-1094956448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-d8a5d562-779d-4245-a7af-02c73989c0ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38fc2d15-3fbc-4674-8b5e-951c43661707', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:39:46 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-4141d71d-fb00-4223-84e8-0a28bf4176b9 req-0ae6bacb-4492-41e1-a46f-5df507685ce4 tempest-TestInstancesWithCinderVolumes-1094956448 None] attachment_update completed successfully.
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (b269c7ac-3c62-4d9c-bee0-7d8b9143202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5abfedb-5f5e-4a24-8ccd-d0eb3e5606b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5abfedb-5f5e-4a24-8ccd-d0eb3e5606b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-126325351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:48Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a53658c-9c4e-4aab-9dc6-459434928495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a53658c-9c4e-4aab-9dc6-459434928495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9676f0-e1c6-4dec-8e84-94162e66848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9676f0-e1c6-4dec-8e84-94162e66848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4', 'volume_name': 'volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a0857-4850-4cab-86af-84b45a0e60d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016a0857-4850-4cab-86af-84b45a0e60d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37aa4d4-863e-4c6a-8de7-e74d8bdf1e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Volume 4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4', 'volume_size': 1}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-126325351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:48Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Creating volume 4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:48 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:48 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 1073741824
Sep 08 16:39:48 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-1e7f636d-60d2-44f5-9304-89374137e400 req-5ef124a8-123a-4285-ab05-ed8ba7f6708d tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:49 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 1073741824" returned: 0 in 0.694s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:49 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4
Sep 08 16:39:49 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:49 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4" returned: 0 in 0.275s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-1e7f636d-60d2-44f5-9304-89374137e400 req-5ef124a8-123a-4285-ab05-ed8ba7f6708d tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.538s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37aa4d4-863e-4c6a-8de7-e74d8bdf1e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24f3a57-d76a-4173-881a-94e3a48aabe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Volume volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 (4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4): created successfully
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f24f3a57-d76a-4173-881a-94e3a48aabe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (b269c7ac-3c62-4d9c-bee0-7d8b9143202a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-1e7f636d-60d2-44f5-9304-89374137e400 req-5ef124a8-123a-4285-ab05-ed8ba7f6708d tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.076s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-848d945c-3d2d-475e-89f4-b2a698e66a64 tempest-VolumesActionsTest-869865825 None] Created volume successfully.
Sep 08 16:39:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-1e7f636d-60d2-44f5-9304-89374137e400 req-5ef124a8-123a-4285-ab05-ed8ba7f6708d tempest-TestInstancesWithCinderVolumes-1094956448 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-4b9feca0-4892-4d26-b206-39db38ba6bd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d8d775f-e9c3-4300-95a4-8aaac85cb73d', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:39:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-1e7f636d-60d2-44f5-9304-89374137e400 req-5ef124a8-123a-4285-ab05-ed8ba7f6708d tempest-TestInstancesWithCinderVolumes-1094956448 None] attachment_update completed successfully.
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Lock "cinder-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-quobyte-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4" acquired by "delete_volume" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[376d3fc2-0003-48d1-add7-2a15f094509e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:50 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4
Sep 08 16:39:50 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:50 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4" returned: 0 in 0.468s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:50 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4
Sep 08 16:39:50 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:51 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4" returned: 0 in 0.311s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4" released by "delete_volume" :: held 0.874s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Created reservations ['70e7281c-b59e-48d0-a230-1c22f9111bd5', 'aa45592a-ae5c-43d2-8de8-939d682652b7', '8c093c85-39eb-49b3-83f3-6e85bf93d4a1', 'd0f3c997-4bf9-4532-bbd8-2f5d0e18a8e2'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:51 devstack sudo[97885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:51 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:51 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.369s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Deleted volume successfully.
Sep 08 16:39:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-210c8c57-100e-456e-a3f7-81ea9c18c6ec tempest-VolumesActionsTest-1582310018 None] Lock "cinder-4e74bcc5-ecf1-433a-80e7-d0d3a2551fa4-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Flow 'volume_create_manager' (181f5649-cf76-4dfa-b0e1-80d34f649e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7450029-69ff-46e4-a032-69b8f7d50198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7450029-69ff-46e4-a032-69b8f7d50198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2039046124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88901fc-54ba-4663-8ff1-fb9e17e6210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c421c9d5f594bcdb81e8d1cc7f752ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:52Z,use_quota=True,user_id='d85f8251747f4c7ba36750f00bbba8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1aefb4-8fd2-4e9a-ac91-056e11579fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1aefb4-8fd2-4e9a-ac91-056e11579fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f168f-f104-4c49-9922-05e7c54ee1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (9b725e6e-c45d-4344-acbe-b3a283dc050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4804e83d-438c-45ed-8091-7784af6c3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f168f-f104-4c49-9922-05e7c54ee1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a88901fc-54ba-4663-8ff1-fb9e17e6210d', 'volume_name': 'volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343646daf0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf95d83-fcde-47ed-a6f9-9fbc1a68381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf95d83-fcde-47ed-a6f9-9fbc1a68381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eac5dee-9137-4635-98b3-468da9f0eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Volume a88901fc-54ba-4663-8ff1-fb9e17e6210d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343646daf0>}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Trying to clone a88901fc-54ba-4663-8ff1-fb9e17e6210d from image 9bf04763-a04a-46d0-817b-b7085cff6448 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4804e83d-438c-45ed-8091-7784af6c3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1862186415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12110412-bbfa-4d01-a2ab-59ede3bf526f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:53Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89c6573-1462-4b71-a4ea-aa072278f4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89c6573-1462-4b71-a4ea-aa072278f4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97e6c6f-f911-4f40-b9dc-e6ffac612682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97e6c6f-f911-4f40-b9dc-e6ffac612682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12110412-bbfa-4d01-a2ab-59ede3bf526f', 'volume_name': 'volume-12110412-bbfa-4d01-a2ab-59ede3bf526f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba33441-5a64-45d5-aa41-efbe0ece7c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba33441-5a64-45d5-aa41-efbe0ece7c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bcf4fe-9b4f-41d3-9370-6664cfd56d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Volume 12110412-bbfa-4d01-a2ab-59ede3bf526f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12110412-bbfa-4d01-a2ab-59ede3bf526f', 'volume_size': 1}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1862186415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12110412-bbfa-4d01-a2ab-59ede3bf526f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:53Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Creating volume 12110412-bbfa-4d01-a2ab-59ede3bf526f {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:53 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:53 devstack sudo[97911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f 1073741824
Sep 08 16:39:53 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:39:53 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Image download 20.69 MB at 20.69 MB/s
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eee33c-6678-415e-a26a-4fb646fc9133]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:53 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f 1073741824" returned: 0 in 0.786s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:53 devstack sudo[97922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f
Sep 08 16:39:53 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:53 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD
Sep 08 16:39:53 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:54 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 is fetched for user d85f8251747f4c7ba36750f00bbba8ae. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:39:54 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f" returned: 0 in 0.358s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bcf4fe-9b4f-41d3-9370-6664cfd56d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12110412-bbfa-4d01-a2ab-59ede3bf526f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40a972e-4540-4fc4-bb42-f805e50a54fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:54 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Volume volume-12110412-bbfa-4d01-a2ab-59ede3bf526f (12110412-bbfa-4d01-a2ab-59ede3bf526f): created successfully
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40a972e-4540-4fc4-bb42-f805e50a54fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (9b725e6e-c45d-4344-acbe-b3a283dc050b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2510437a-8bfa-486d-bab6-08681f33746d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-753c141d-76f6-4704-bc61-20546426b4ee tempest-VolumesActionsTest-869865825 None] Created volume successfully.
Sep 08 16:39:54 devstack sudo[97933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD
Sep 08 16:39:54 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:54 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2039046124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88901fc-54ba-4663-8ff1-fb9e17e6210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c421c9d5f594bcdb81e8d1cc7f752ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:52Z,use_quota=True,user_id='d85f8251747f4c7ba36750f00bbba8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Creating volume a88901fc-54ba-4663-8ff1-fb9e17e6210d {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:54 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:54 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 1073741824
Sep 08 16:39:54 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-12110412-bbfa-4d01-a2ab-59ede3bf526f-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-12110412-bbfa-4d01-a2ab-59ede3bf526f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-quobyte-12110412-bbfa-4d01-a2ab-59ede3bf526f" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-12110412-bbfa-4d01-a2ab-59ede3bf526f" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7e08c7-f86e-4f94-ae30-2eee5b6d2254]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:55 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 1073741824" returned: 0 in 0.610s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:55 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d
Sep 08 16:39:55 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:55 devstack sudo[97961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f
Sep 08 16:39:55 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:55 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d" returned: 0 in 0.379s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Attempting download of 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume a88901fc-54ba-4663-8ff1-fb9e17e6210d. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:39:55 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f" returned: 0 in 0.543s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:55 devstack sudo[97971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f
Sep 08 16:39:55 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad6654-81af-4b05-8682-b47896b72d29]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_ljbarb6z {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:56 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_ljbarb6z
Sep 08 16:39:56 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:56 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-12110412-bbfa-4d01-a2ab-59ede3bf526f" returned: 0 in 0.362s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-12110412-bbfa-4d01-a2ab-59ede3bf526f" released by "delete_volume" :: held 0.955s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:56 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_ljbarb6z" returned: 0 in 0.402s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_ljbarb6z {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Created reservations ['8bd98bdf-14d2-4b32-9e87-d08d5cb318f5', '7eef4794-5754-41f6-b336-42c4a665ce10', '906f2356-e908-4d89-8593-2c610cbe2ca3', 'e8502dcd-36e7-4087-84a4-fff42de4abd1'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-a6dce3a5-6f58-40e3-b4d9-973d4b479a9f req-2a8fee00-8788-4e13-90b2-63724ecdc205 tempest-TestInstancesWithCinderVolumes-1094956448 None] Terminate volume connection completed successfully.
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-a6dce3a5-6f58-40e3-b4d9-973d4b479a9f req-2a8fee00-8788-4e13-90b2-63724ecdc205 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deleting attachment 38fc2d15-3fbc-4674-8b5e-951c43661707. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:39:56 devstack sudo[97980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_ljbarb6z
Sep 08 16:39:56 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:56 devstack sudo[97982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:56 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:56 devstack sudo[97983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:56 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:56 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.308s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Deleted volume successfully.
Sep 08 16:39:56 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_ljbarb6z" returned: 1 in 0.599s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_ljbarb6z' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:39:56 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07aa6bc-f612-4cc0-96ba-495e2ef1d599]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8fb3491-49d1-47c5-ad26-eba06279e834 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-12110412-bbfa-4d01-a2ab-59ede3bf526f-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.343s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:39:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:39:57 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD
Sep 08 16:39:57 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "cinder-d8a5d562-779d-4245-a7af-02c73989c0ca-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-d8a5d562-779d-4245-a7af-02c73989c0ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "cinder-quobyte-d8a5d562-779d-4245-a7af-02c73989c0ca" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-quobyte-d8a5d562-779d-4245-a7af-02c73989c0ca" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3555fd3f-5500-4be0-9d59-e30f78e8ad06]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:57 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] 9bf04763-a04a-46d0-817b-b7085cff6448 was qcow2, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:57 devstack sudo[97996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca
Sep 08 16:39:57 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:57 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d
Sep 08 16:39:57 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:57 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca" returned: 0 in 0.563s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:57 devstack sudo[98011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca
Sep 08 16:39:57 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:58 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d8a5d562-779d-4245-a7af-02c73989c0ca" returned: 0 in 0.448s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-quobyte-d8a5d562-779d-4245-a7af-02c73989c0ca" released by "delete_volume" :: held 1.065s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (f3bea0f6-428b-4160-9985-2a319395372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad91d39-8817-4b83-85e6-dffbffd11b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad91d39-8817-4b83-85e6-dffbffd11b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423543769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aefe9c-9784-422a-a0f0-c6fb484fc10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:58Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b7cbdd-ce63-4b28-a026-4bcfbb7afb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b7cbdd-ce63-4b28-a026-4bcfbb7afb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b252c947-9c9f-4903-86b1-76a69a465318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b252c947-9c9f-4903-86b1-76a69a465318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92aefe9c-9784-422a-a0f0-c6fb484fc10e', 'volume_name': 'volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4201df-0f80-4a6a-8587-4356ac2adcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4201df-0f80-4a6a-8587-4356ac2adcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64734e5e-9905-4391-bccb-882f482fc747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:58 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Volume 92aefe9c-9784-422a-a0f0-c6fb484fc10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e', 'volume_size': 1}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423543769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aefe9c-9784-422a-a0f0-c6fb484fc10e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:39:58Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Creating volume 92aefe9c-9784-422a-a0f0-c6fb484fc10e {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:39:58 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:58 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e 1073741824
Sep 08 16:39:58 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:58 devstack cinder-volume[87505]: WARNING cinder.quota [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061564392-1053959826 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061564392-1053959826, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:39:58 devstack cinder-volume[87505]: WARNING cinder.quota [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061564392-1053959826 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2061564392-1053959826, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Created reservations ['7b11868e-af54-40c6-9b90-fcd70463f51d', '2b87690b-ee1f-41f7-bb1c-f8226f49f945', '19be3308-2179-4bde-9d89-5f285db7dfca', '3079ef84-b1cf-4cb5-8292-8815f7f7d1fd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:58 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:39:58 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:59 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.419s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:39:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deleted volume successfully.
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-33f98cf8-5136-419e-987d-358b4cb41e87 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-d8a5d562-779d-4245-a7af-02c73989c0ca-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:39:59 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e 1073741824" returned: 0 in 0.852s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:59 devstack sudo[98024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e
Sep 08 16:39:59 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:39:59 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e" returned: 0 in 0.298s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64734e5e-9905-4391-bccb-882f482fc747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74507ce-9fa4-4b8c-b8bc-944223cb6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:39:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Volume volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e (92aefe9c-9784-422a-a0f0-c6fb484fc10e): created successfully
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74507ce-9fa4-4b8c-b8bc-944223cb6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (f3bea0f6-428b-4160-9985-2a319395372d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:39:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-dcaeeeb8-626a-4583-ae41-0db0a5db2d5a tempest-VolumesActionsTest-869865825 None] Created volume successfully.
Sep 08 16:39:59 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d" returned: 0 in 2.558s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448__u4adffvdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:39:59 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Converted 112.00 MB image at 43.76 MB/s
Sep 08 16:39:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:39:59 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 1G
Sep 08 16:39:59 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:00 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 1G" returned: 0 in 0.422s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Downloaded image 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume a88901fc-54ba-4663-8ff1-fb9e17e6210d successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 for user d85f8251747f4c7ba36750f00bbba8ae is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Marking volume a88901fc-54ba-4663-8ff1-fb9e17e6210d as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Copying metadata from image 9bf04763-a04a-46d0-817b-b7085cff6448 to a88901fc-54ba-4663-8ff1-fb9e17e6210d. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Creating volume glance metadata for volume a88901fc-54ba-4663-8ff1-fb9e17e6210d backed by image 9bf04763-a04a-46d0-817b-b7085cff6448 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eac5dee-9137-4635-98b3-468da9f0eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343646daf0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a048699-18ac-4523-a22f-8d50512c419c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:00 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Volume volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d (a88901fc-54ba-4663-8ff1-fb9e17e6210d): created successfully
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a048699-18ac-4523-a22f-8d50512c419c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Flow 'volume_create_manager' (181f5649-cf76-4dfa-b0e1-80d34f649e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-92aefe9c-9784-422a-a0f0-c6fb484fc10e-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-132ae987-ee8d-4357-92e6-e468f82f0651 tempest-VolumesExtendTest-2122457826 None] Created volume successfully.
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Lock "cinder-92aefe9c-9784-422a-a0f0-c6fb484fc10e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-quobyte-92aefe9c-9784-422a-a0f0-c6fb484fc10e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-92aefe9c-9784-422a-a0f0-c6fb484fc10e" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c724eb4e-f766-4014-a712-fcfbc155dada]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:00 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e
Sep 08 16:40:00 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:01 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e" returned: 0 in 0.382s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:01 devstack sudo[98060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e
Sep 08 16:40:01 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7daad7-7757-4551-a9c7-178c9bab223c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:01 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92aefe9c-9784-422a-a0f0-c6fb484fc10e" returned: 0 in 0.347s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-92aefe9c-9784-422a-a0f0-c6fb484fc10e" released by "delete_volume" :: held 0.779s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:01 devstack sudo[98064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d
Sep 08 16:40:01 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Created reservations ['2dedb29d-8c61-47a6-964f-8d511896b594', 'ae564959-cf41-4b7d-9c16-03bfcbc0ae14', 'b785fe80-5902-4486-ae62-203cac49ac91', '9ecf01e5-a588-43b9-9ce8-51c2a568c494'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:01 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:01 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:01 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d" returned: 0 in 0.564s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 2G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:01 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d 2G" returned: 0 in 0.149s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.749s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.446s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Deleted volume successfully.
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dd54d15-47de-4a2a-a84d-3ef55aaea91e tempest-VolumesActionsTest-1582310018 None] Lock "cinder-92aefe9c-9784-422a-a0f0-c6fb484fc10e-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-17c33c77-db01-466a-ab77-96e81401a235 tempest-VolumesExtendTest-2122457826 None] Extend volume completed successfully.
Sep 08 16:40:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-93598ac6-185e-420b-8e7b-1a2cb8f01edc req-9cf42a4e-01a3-43d1-9e0a-ea7dd5bf1424 tempest-TestInstancesWithCinderVolumes-1094956448 None] Terminate volume connection completed successfully.
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-93598ac6-185e-420b-8e7b-1a2cb8f01edc req-9cf42a4e-01a3-43d1-9e0a-ea7dd5bf1424 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deleting attachment 0d8d775f-e9c3-4300-95a4-8aaac85cb73d. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (cc080a89-69d3-4f5d-ab10-f0ea3e0c9d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82264ae-d88c-40fa-9962-36892d94b9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82264ae-d88c-40fa-9962-36892d94b9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1269297587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43b8085-8610-4c8e-942a-48df03620bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:03Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a583e0-2d57-4a89-b438-79baf6f49eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a583e0-2d57-4a89-b438-79baf6f49eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf6aa09-81bc-4112-83f4-81682095d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf6aa09-81bc-4112-83f4-81682095d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a43b8085-8610-4c8e-942a-48df03620bc8', 'volume_name': 'volume-a43b8085-8610-4c8e-942a-48df03620bc8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39103cfb-5db8-4de1-8b1d-613756050503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39103cfb-5db8-4de1-8b1d-613756050503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8d735b-2c0e-478f-8841-7e9ff9abcb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:02 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Volume a43b8085-8610-4c8e-942a-48df03620bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a43b8085-8610-4c8e-942a-48df03620bc8', 'volume_size': 1}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1269297587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43b8085-8610-4c8e-942a-48df03620bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:03Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Creating volume a43b8085-8610-4c8e-942a-48df03620bc8 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:02 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:02 devstack sudo[98102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8 1073741824
Sep 08 16:40:02 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Acquiring lock "cinder-a88901fc-54ba-4663-8ff1-fb9e17e6210d-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Lock "cinder-a88901fc-54ba-4663-8ff1-fb9e17e6210d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "cinder-4b9feca0-4892-4d26-b206-39db38ba6bd2-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Acquiring lock "cinder-quobyte-a88901fc-54ba-4663-8ff1-fb9e17e6210d" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-4b9feca0-4892-4d26-b206-39db38ba6bd2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-a88901fc-54ba-4663-8ff1-fb9e17e6210d" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d12c609-3e31-438f-ba65-011799f48b96]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "cinder-quobyte-4b9feca0-4892-4d26-b206-39db38ba6bd2" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-quobyte-4b9feca0-4892-4d26-b206-39db38ba6bd2" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd220fa-0245-4e50-a3f7-1f7d9ab5e2a0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:03 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d
Sep 08 16:40:03 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:03 devstack sudo[98108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2
Sep 08 16:40:03 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:03 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8 1073741824" returned: 0 in 0.519s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:03 devstack sudo[98112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8
Sep 08 16:40:03 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:03 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d" returned: 0 in 0.495s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:03 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2" returned: 0 in 0.421s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:03 devstack sudo[98121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d
Sep 08 16:40:03 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:03 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2
Sep 08 16:40:03 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:03 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8" returned: 0 in 0.349s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8d735b-2c0e-478f-8841-7e9ff9abcb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a43b8085-8610-4c8e-942a-48df03620bc8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9c8446-6e40-405d-9cc3-bca83b487e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:03 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Volume volume-a43b8085-8610-4c8e-942a-48df03620bc8 (a43b8085-8610-4c8e-942a-48df03620bc8): created successfully
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9c8446-6e40-405d-9cc3-bca83b487e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (cc080a89-69d3-4f5d-ab10-f0ea3e0c9d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-123f0621-df26-4f3b-8d48-3db28d76b6e3 tempest-VolumesActionsTest-869865825 None] Created volume successfully.
Sep 08 16:40:03 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a88901fc-54ba-4663-8ff1-fb9e17e6210d" returned: 0 in 0.334s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-a88901fc-54ba-4663-8ff1-fb9e17e6210d" released by "delete_volume" :: held 0.875s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:03 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b9feca0-4892-4d26-b206-39db38ba6bd2" returned: 0 in 0.345s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-quobyte-4b9feca0-4892-4d26-b206-39db38ba6bd2" released by "delete_volume" :: held 0.817s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:03 devstack cinder-volume[87505]: WARNING cinder.quota [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255533322-1132784483 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255533322-1132784483, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:40:03 devstack cinder-volume[87505]: WARNING cinder.quota [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255533322-1132784483 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255533322-1132784483, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Created reservations ['bb9e5006-fff9-4e62-ba25-3ec4ffd9f610', '76e28b59-7c50-4137-9b60-802b4ab6c0c6', '4415ca4f-f4b5-447f-a46a-f7b0a1610473', 'b8d76e18-d958-4d9a-8591-03fb3d0cc3ff'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Created reservations ['1f215b9c-f21a-47e1-b608-916f880167ce', '2d0c76c4-49e7-4ba5-9b02-940e5a54d135', '7ce2fa44-1f0a-4d55-9cec-5631e9c8b7f6', '646d3cd1-616c-47cd-a8d2-5cc47cc99dfd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:03 devstack sudo[98128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:03 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:04 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:04 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:04 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.320s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:04 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Deleted volume successfully.
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-09ebc228-a031-4bbf-b287-567d7a051bbd tempest-VolumesExtendTest-2122457826 None] Lock "cinder-a88901fc-54ba-4663-8ff1-fb9e17e6210d-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:04 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.299s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:04 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deleted volume successfully.
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-695da8bb-c8c8-427f-8435-2b2015472e29 tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-4b9feca0-4892-4d26-b206-39db38ba6bd2-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Flow 'volume_create_manager' (ec15a98b-13e7-41db-84dd-347d823e6709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a198e5d-8fbf-4bc1-93c9-35e0512b1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a198e5d-8fbf-4bc1-93c9-35e0512b1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348656289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1da4b3-54d0-4277-9648-1c94b690aa47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c421c9d5f594bcdb81e8d1cc7f752ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:05Z,use_quota=True,user_id='d85f8251747f4c7ba36750f00bbba8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd8ca76-1342-495d-90ec-3748fbc958c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd8ca76-1342-495d-90ec-3748fbc958c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920f5e3d-6325-4d3e-9716-11c368c3ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920f5e3d-6325-4d3e-9716-11c368c3ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1da4b3-54d0-4277-9648-1c94b690aa47', 'volume_name': 'volume-af1da4b3-54d0-4277-9648-1c94b690aa47', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb33810-1ddd-45f5-ba8e-862cae51e2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb33810-1ddd-45f5-ba8e-862cae51e2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecff227d-c203-4f97-b499-74b48af9cdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:04 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Volume af1da4b3-54d0-4277-9648-1c94b690aa47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1da4b3-54d0-4277-9648-1c94b690aa47', 'volume_size': 1}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-348656289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1da4b3-54d0-4277-9648-1c94b690aa47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c421c9d5f594bcdb81e8d1cc7f752ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:05Z,use_quota=True,user_id='d85f8251747f4c7ba36750f00bbba8ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Creating volume af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:04 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:04 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 1073741824
Sep 08 16:40:04 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-a43b8085-8610-4c8e-942a-48df03620bc8-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-a43b8085-8610-4c8e-942a-48df03620bc8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Acquiring lock "cinder-quobyte-a43b8085-8610-4c8e-942a-48df03620bc8" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-a43b8085-8610-4c8e-942a-48df03620bc8" acquired by "delete_volume" :: waited 0.039s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d962d4f4-1383-4326-b231-0e4adc853ab2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:05 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8
Sep 08 16:40:05 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:05 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 1073741824" returned: 0 in 0.505s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:05 devstack sudo[98143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47
Sep 08 16:40:05 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:05 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8" returned: 0 in 0.388s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:05 devstack sudo[98148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8
Sep 08 16:40:05 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:05 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47" returned: 0 in 0.278s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecff227d-c203-4f97-b499-74b48af9cdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1da4b3-54d0-4277-9648-1c94b690aa47', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066d829-81da-4f78-9ae3-42f748fee2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:05 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Volume volume-af1da4b3-54d0-4277-9648-1c94b690aa47 (af1da4b3-54d0-4277-9648-1c94b690aa47): created successfully
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b066d829-81da-4f78-9ae3-42f748fee2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Flow 'volume_create_manager' (ec15a98b-13e7-41db-84dd-347d823e6709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0472e8b8-8c23-4f71-bd29-d37509610b11 tempest-VolumesExtendTest-2122457826 None] Created volume successfully.
Sep 08 16:40:05 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a43b8085-8610-4c8e-942a-48df03620bc8" returned: 0 in 0.311s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-quobyte-a43b8085-8610-4c8e-942a-48df03620bc8" released by "delete_volume" :: held 0.763s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Created reservations ['9abc19ff-2e04-4c72-8253-3fb60df8d62e', 'ef4ae5cf-5655-4679-842d-2cfae8dd5942', '5c8c7864-fba8-4ea2-bdc8-b202028c835d', 'af590731-4171-42e9-b030-98dabd870211'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:06 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:06 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:06 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.304s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:06 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Deleted volume successfully.
Sep 08 16:40:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-204487ba-dd84-489b-90a1-55923747ca15 tempest-VolumesActionsTest-1582310018 None] Lock "cinder-a43b8085-8610-4c8e-942a-48df03620bc8-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (3656bf44-caaf-4bb0-828a-2f387d79bfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d85942c-1726-44eb-9e37-1d550103a10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d85942c-1726-44eb-9e37-1d550103a10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578256674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a823c332-01fa-4fec-b92f-653d054e493e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:07Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4067f43-cb85-4c98-bd13-196bcdbe5bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4067f43-cb85-4c98-bd13-196bcdbe5bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13214be-14fc-45a1-8e22-1980f1ae005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13214be-14fc-45a1-8e22-1980f1ae005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a823c332-01fa-4fec-b92f-653d054e493e', 'volume_name': 'volume-a823c332-01fa-4fec-b92f-653d054e493e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffccd93-f20d-4e4a-9ee6-b15f7bc9bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ffccd93-f20d-4e4a-9ee6-b15f7bc9bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242779a-9ba8-462d-bc2c-0444577731d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Volume a823c332-01fa-4fec-b92f-653d054e493e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a823c332-01fa-4fec-b92f-653d054e493e', 'volume_size': 1}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-578256674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a823c332-01fa-4fec-b92f-653d054e493e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a826e9fecce748ae82ff7616be3107c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:07Z,use_quota=True,user_id='5f173206a23d4105ba17c0806dc3d5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Creating volume a823c332-01fa-4fec-b92f-653d054e493e {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:07 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:07 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e 1073741824
Sep 08 16:40:07 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-f6615cd1-5f0a-4da2-8333-459763e7bf24 req-03eacb15-0172-42ae-a8ec-776d27316b44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Terminate volume connection completed successfully.
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-f6615cd1-5f0a-4da2-8333-459763e7bf24 req-03eacb15-0172-42ae-a8ec-776d27316b44 tempest-TestInstancesWithCinderVolumes-1094956448 None] Deleting attachment 78736c4f-0b1f-4f68-adab-a69278fc892b. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:40:07 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e 1073741824" returned: 0 in 0.473s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:07 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e
Sep 08 16:40:07 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:07 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.727s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242779a-9ba8-462d-bc2c-0444577731d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a823c332-01fa-4fec-b92f-653d054e493e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2df54f5-1a86-4536-94ac-83ff6ac31588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Creating offline snapshot 86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 of volume af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:40:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Volume volume-a823c332-01fa-4fec-b92f-653d054e493e (a823c332-01fa-4fec-b92f-653d054e493e): created successfully
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2df54f5-1a86-4536-94ac-83ff6ac31588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Flow 'volume_create_manager' (3656bf44-caaf-4bb0-828a-2f387d79bfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[809d8409-6b6e-481d-bb72-7048e1f6195e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:08 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7a20b2ee-c703-4477-9ffd-cb642ff6a369 tempest-VolumesActionsTest-869865825 None] Created volume successfully.
Sep 08 16:40:08 devstack sudo[98195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47
Sep 08 16:40:08 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:08 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47" returned: 0 in 0.389s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:08 devstack sudo[98200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 1G
Sep 08 16:40:08 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "cinder-073baac3-a049-405e-b6f7-6a97ac9ce22a-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-073baac3-a049-405e-b6f7-6a97ac9ce22a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "cinder-quobyte-073baac3-a049-405e-b6f7-6a97ac9ce22a" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-quobyte-073baac3-a049-405e-b6f7-6a97ac9ce22a" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cce347-8daa-4e04-a820-adda77d5f03e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:08 devstack sudo[98202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a
Sep 08 16:40:08 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:08 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 1G" returned: 0 in 0.564s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af1da4b3-54d0-4277-9648-1c94b690aa47 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:08 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af1da4b3-54d0-4277-9648-1c94b690aa47 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98
Sep 08 16:40:08 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:09 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a" returned: 0 in 0.442s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:09 devstack sudo[98213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a
Sep 08 16:40:09 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:09 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af1da4b3-54d0-4277-9648-1c94b690aa47 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:09 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 is being set with open permissions: ugo+rw
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:09 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98
Sep 08 16:40:09 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:09 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-073baac3-a049-405e-b6f7-6a97ac9ce22a" returned: 0 in 0.315s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-quobyte-073baac3-a049-405e-b6f7-6a97ac9ce22a" released by "delete_volume" :: held 0.806s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:09 devstack cinder-volume[87505]: WARNING cinder.quota [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422965516-914078082 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422965516-914078082, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:40:09 devstack cinder-volume[87505]: WARNING cinder.quota [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422965516-914078082 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422965516-914078082, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Created reservations ['89f32803-b52d-478d-bbd1-9cb937dbc500', '0a0f6bac-1436-422e-bfd6-8c6863faa8b0', '088ca615-dbcf-4156-bdec-9046d3b5204f', '328ab2cc-d783-4e69-8e7f-06020eccf02f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:09 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" returned: 0 in 0.305s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:09 devstack sudo[98223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:09 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:09 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.info
Sep 08 16:40:09 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Acquiring lock "cinder-a823c332-01fa-4fec-b92f-653d054e493e-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Lock "cinder-a823c332-01fa-4fec-b92f-653d054e493e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Acquiring lock "cinder-quobyte-a823c332-01fa-4fec-b92f-653d054e493e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Lock "cinder-quobyte-a823c332-01fa-4fec-b92f-653d054e493e" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:09 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.412s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:09 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Deleted volume successfully.
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4006dd6-76df-475d-a3c7-3414eae34a0d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:10 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.info" returned: 0 in 0.389s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:10 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.info is being set with open permissions: ugo+rw
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d4b79f73-7cdb-408e-a0b4-b1fd25bdacdf tempest-TestInstancesWithCinderVolumes-1094956448 None] Lock "cinder-073baac3-a049-405e-b6f7-6a97ac9ce22a-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:10 devstack sudo[98230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.info
Sep 08 16:40:10 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:10 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e
Sep 08 16:40:10 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:10 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.info" returned: 0 in 0.419s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:10 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e" returned: 0 in 0.463s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:10 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e
Sep 08 16:40:10 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a861f600-1f0b-4280-bd2e-4ab073b89867 tempest-VolumesExtendTest-2122457826 None] Create snapshot completed successfully
Sep 08 16:40:10 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a823c332-01fa-4fec-b92f-653d054e493e" returned: 0 in 0.246s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Lock "cinder-quobyte-a823c332-01fa-4fec-b92f-653d054e493e" released by "delete_volume" :: held 0.784s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Created reservations ['39939d80-1d7a-413e-8213-3af6f437a610', '3aae79d3-3a73-4234-84e9-770f66a3f43f', '28cd74e2-4376-448f-9eff-9c8f7ef48344', '975af30d-5e70-4170-98d3-3d349cd4d214'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:10 devstack sudo[98240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:10 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:11 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.265s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:11 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Deleted volume successfully.
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9c6997eb-adbe-4517-8c51-b9e1b3034948 tempest-VolumesActionsTest-869865825 None] Lock "cinder-a823c332-01fa-4fec-b92f-653d054e493e-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf69390e-55fd-4925-bd00-09ae4f7b76ee]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:11 devstack sudo[98243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47
Sep 08 16:40:11 devstack sudo[98243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:11 devstack sudo[98243]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47" returned: 0 in 0.402s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 2G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 2G" returned: 0 in 0.131s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.587s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:11 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-fd15db90-17ad-42fa-9bc6-62db8e2508ce tempest-VolumesExtendTest-2122457826 None] Extend volume completed successfully.
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "cinder-86eaacbd-1bb0-4df2-93f2-df37cd2d4d98-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-86eaacbd-1bb0-4df2-93f2-df37cd2d4d98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "cinder-quobyte-af1da4b3-54d0-4277-9648-1c94b690aa47" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-af1da4b3-54d0-4277-9648-1c94b690aa47" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "cinder-quobyte-86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Deleting offline snapshot 86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 of volume af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] snapshot_file for this snap is: volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f50ba-e231-420a-a32f-2003b1d997d7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:12 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98
Sep 08 16:40:12 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:13 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" returned: 0 in 0.528s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af1da4b3-54d0-4277-9648-1c94b690aa47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c582b3b-3ffc-4e4f-a9c8-ebc9df2be8b7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Flow 'volume_create_manager' (6091cdc0-3b95-4ef6-8289-8efee096d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54b9c9b-3654-45ed-b6e0-f224494249d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e54b9c9b-3654-45ed-b6e0-f224494249d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-142855633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed706f06-72cd-4ee7-ae93-0cf92e660a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b6e941988a4eb08401b7bbe45ebffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:13Z,use_quota=True,user_id='dd34c8a83ac64ab18890e6ff9f470a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45717733-69fc-4e9f-934c-7ee7083406f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45717733-69fc-4e9f-934c-7ee7083406f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277b34ec-cd28-4cd4-8e48-de839904e7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:13 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47
Sep 08 16:40:13 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277b34ec-cd28-4cd4-8e48-de839904e7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed706f06-72cd-4ee7-ae93-0cf92e660a1f', 'volume_name': 'volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e91233-8179-443c-b084-86acd1d641c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e91233-8179-443c-b084-86acd1d641c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cf9026-d1f1-40dd-a705-3d02f334abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:13 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Volume ed706f06-72cd-4ee7-ae93-0cf92e660a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f', 'volume_size': 1}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-142855633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed706f06-72cd-4ee7-ae93-0cf92e660a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b6e941988a4eb08401b7bbe45ebffb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:13Z,use_quota=True,user_id='dd34c8a83ac64ab18890e6ff9f470a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Creating volume ed706f06-72cd-4ee7-ae93-0cf92e660a1f {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:13 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:13 devstack sudo[98263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f 1073741824
Sep 08 16:40:13 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:13 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47" returned: 0 in 0.455s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:13 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98
Sep 08 16:40:13 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:13 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f 1073741824" returned: 0 in 0.457s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:14 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f
Sep 08 16:40:14 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:14 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" returned: 0 in 0.449s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:14 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98
Sep 08 16:40:14 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:14 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f" returned: 0 in 0.357s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8cf9026-d1f1-40dd-a705-3d02f334abba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1ee422-4c85-4d74-8574-5bf78fa1e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Volume volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f (ed706f06-72cd-4ee7-ae93-0cf92e660a1f): created successfully
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1ee422-4c85-4d74-8574-5bf78fa1e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Flow 'volume_create_manager' (6091cdc0-3b95-4ef6-8289-8efee096d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e00a0b14-ef0b-4804-805e-f0a964452bb8 tempest-AttachVolumeNegativeTest-1876492861 None] Created volume successfully.
Sep 08 16:40:14 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47.86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" returned: 0 in 0.351s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-86eaacbd-1bb0-4df2-93f2-df37cd2d4d98" released by "_delete_snapshot" :: held 1.980s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-af1da4b3-54d0-4277-9648-1c94b690aa47" released by "delete_snapshot" :: held 2.008s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Created reservations ['c11e0b11-5e97-4a7b-b491-c8e7589c0849', '25942b04-34d7-46d9-a11b-e37bb6e23217', 'd1a1f8ee-70ca-4f76-8f4b-374bf418023d', '653a7eb4-8209-4756-9da7-d8afcdb9d6b8'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Delete snapshot completed successfully.
Sep 08 16:40:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2dae30b7-3a24-4618-aed2-71cf2cba6858 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-86eaacbd-1bb0-4df2-93f2-df37cd2d4d98-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "cinder-af1da4b3-54d0-4277-9648-1c94b690aa47-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-af1da4b3-54d0-4277-9648-1c94b690aa47-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "cinder-quobyte-af1da4b3-54d0-4277-9648-1c94b690aa47" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-af1da4b3-54d0-4277-9648-1c94b690aa47" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c871a98-e888-42e1-b836-9ad5bf5a2288]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:16 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47
Sep 08 16:40:16 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c478ceba-67dd-4f04-91a1-687862e2ec1c req-6ede861e-72ac-42c5-90a4-a8925b272a56 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c478ceba-67dd-4f04-91a1-687862e2ec1c req-6ede861e-72ac-42c5-90a4-a8925b272a56 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c478ceba-67dd-4f04-91a1-687862e2ec1c req-6ede861e-72ac-42c5-90a4-a8925b272a56 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c478ceba-67dd-4f04-91a1-687862e2ec1c req-6ede861e-72ac-42c5-90a4-a8925b272a56 tempest-AttachVolumeNegativeTest-1876492861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b72dfd5d-d4be-481c-9133-d71daecc8ab5', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=150,cinder:UPDATE=171,cinder:INSERT=42,cinder:DELETE=12 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=144,cinder:UPDATE=161,cinder:INSERT=43,cinder:DELETE=15 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:40:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-c478ceba-67dd-4f04-91a1-687862e2ec1c req-6ede861e-72ac-42c5-90a4-a8925b272a56 tempest-AttachVolumeNegativeTest-1876492861 None] attachment_update completed successfully.
Sep 08 16:40:16 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47" returned: 0 in 0.566s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:16 devstack sudo[98324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47
Sep 08 16:40:16 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:17 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af1da4b3-54d0-4277-9648-1c94b690aa47" returned: 0 in 0.351s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-quobyte-af1da4b3-54d0-4277-9648-1c94b690aa47" released by "delete_volume" :: held 1.033s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Created reservations ['2731d2f2-e740-472f-831a-ea9094df1a8a', '9a619fed-5128-4b85-b81e-b831ef36c491', 'fba8f44c-b6df-47f5-b073-dbd988cad754', '79b88464-0853-4595-ad9e-35c56995a19c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:17 devstack sudo[98687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:17 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:17 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.326s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Deleted volume successfully.
Sep 08 16:40:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b406b158-05dc-44fd-8994-53a43a213c00 tempest-VolumesExtendTest-2122457826 None] Lock "cinder-af1da4b3-54d0-4277-9648-1c94b690aa47-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-cc4874cf-0877-4707-9f8b-f001983e0814 req-d3b0e263-1085-48fd-9667-da138dc45c80 tempest-AttachVolumeNegativeTest-1876492861 None] Terminate volume connection completed successfully.
Sep 08 16:40:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-cc4874cf-0877-4707-9f8b-f001983e0814 req-d3b0e263-1085-48fd-9667-da138dc45c80 tempest-AttachVolumeNegativeTest-1876492861 None] Deleting attachment b72dfd5d-d4be-481c-9133-d71daecc8ab5. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "cinder-ed706f06-72cd-4ee7-ae93-0cf92e660a1f-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-ed706f06-72cd-4ee7-ae93-0cf92e660a1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "cinder-quobyte-ed706f06-72cd-4ee7-ae93-0cf92e660a1f" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-quobyte-ed706f06-72cd-4ee7-ae93-0cf92e660a1f" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb5da59-9a40-4dc8-ab81-7e407dec4506]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:26 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f
Sep 08 16:40:26 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:26 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f" returned: 0 in 0.463s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:26 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f
Sep 08 16:40:26 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:27 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed706f06-72cd-4ee7-ae93-0cf92e660a1f" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-quobyte-ed706f06-72cd-4ee7-ae93-0cf92e660a1f" released by "delete_volume" :: held 0.851s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Created reservations ['86b8e348-6298-4082-9f88-dd7c62df7d6b', 'de3b0825-8227-4308-9faa-6af5566a38f2', '4577fc96-9073-4821-8c6a-5a9774a8e70e', 'cc59104c-9852-4fb6-857f-f3c9b186efaf'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:27 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:27 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "cinder-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:27 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.436s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Deleted volume successfully.
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "cinder-quobyte-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4177686a-d772-49e1-a18d-e8f15c7975be tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-ed706f06-72cd-4ee7-ae93-0cf92e660a1f-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-quobyte-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dbc3c3-65d4-460b-bd25-f83057208c1d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:28 devstack sudo[98758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab
Sep 08 16:40:28 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:28 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab" returned: 0 in 0.542s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:28 devstack sudo[98763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab
Sep 08 16:40:28 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:28 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab" returned: 0 in 0.272s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-quobyte-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab" released by "delete_volume" :: held 0.879s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Created reservations ['27087825-3065-4bce-bd5b-72c3560788ff', '84215a24-1abe-4042-98e0-b2a3dd17f14a', 'ab76b0a4-0792-43d0-94a3-9460c6a06d7f', '90db133f-fa6c-43ae-8970-29ec115564ca'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:28 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:28 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:29 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.299s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "cinder-d1e80d79-9e5c-40e2-9dc3-e1b191c87156-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Deleted volume successfully.
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1d8ad56-7621-42d0-b11b-04926b000810 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-c5f7d8c9-a02d-43cb-8aed-75b839e8e8ab-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-d1e80d79-9e5c-40e2-9dc3-e1b191c87156-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "cinder-quobyte-d1e80d79-9e5c-40e2-9dc3-e1b191c87156" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-quobyte-d1e80d79-9e5c-40e2-9dc3-e1b191c87156" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7be4880-0efa-421a-b484-35516426183c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:29 devstack sudo[98770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156
Sep 08 16:40:29 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:29 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156" returned: 0 in 0.455s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:29 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156
Sep 08 16:40:29 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:30 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d1e80d79-9e5c-40e2-9dc3-e1b191c87156" returned: 0 in 0.279s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-quobyte-d1e80d79-9e5c-40e2-9dc3-e1b191c87156" released by "delete_volume" :: held 0.792s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Created reservations ['b903c0ab-1741-40af-aa61-2c33ec2f0071', 'ac9cf6f0-28b6-41a8-8ac8-14b185c3387d', '72642f7c-19da-49a5-9985-11cb217fb7b7', '3278c5c3-46b9-4e02-943d-b186e3800a6d'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:30 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:30 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:30 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.284s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Deleted volume successfully.
Sep 08 16:40:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2f8f4811-f573-4208-9588-155592e8c145 tempest-AttachVolumeNegativeTest-1876492861 None] Lock "cinder-d1e80d79-9e5c-40e2-9dc3-e1b191c87156-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (aa1ccafd-505f-47bd-a202-546ee02a33b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dbe631-1ebc-41db-9b71-40bd5fbe37e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dbe631-1ebc-41db-9b71-40bd5fbe37e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1744957822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd4fcb7-e59c-400c-9ee6-ea8793e1266e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:35Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4880a8de-8dd3-4a64-821d-578e17443f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4880a8de-8dd3-4a64-821d-578e17443f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb252d7a-c6c2-4b71-a240-da7731bf361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb252d7a-c6c2-4b71-a240-da7731bf361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd4fcb7-e59c-400c-9ee6-ea8793e1266e', 'volume_name': 'volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1283209-7db6-48e5-8a82-cd08b1389252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1283209-7db6-48e5-8a82-cd08b1389252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fb548d-d731-47a9-b80f-98cf4fccf50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Volume 1cd4fcb7-e59c-400c-9ee6-ea8793e1266e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e', 'volume_size': 1}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1744957822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd4fcb7-e59c-400c-9ee6-ea8793e1266e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:35Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Creating volume 1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:35 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:35 devstack sudo[98785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e 1073741824
Sep 08 16:40:35 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:35 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e 1073741824" returned: 0 in 0.710s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:35 devstack sudo[98791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e
Sep 08 16:40:35 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:36 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" returned: 0 in 0.413s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fb548d-d731-47a9-b80f-98cf4fccf50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842ec15f-835d-4d4d-8b0f-6299fe15a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:36 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Volume volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e (1cd4fcb7-e59c-400c-9ee6-ea8793e1266e): created successfully
Sep 08 16:40:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842ec15f-835d-4d4d-8b0f-6299fe15a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (aa1ccafd-505f-47bd-a202-546ee02a33b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-37acf1d3-5696-4a82-8fca-783547b0d35e tempest-VolumesSnapshotTestJSON-1721620290 None] Created volume successfully.
Sep 08 16:40:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Creating offline snapshot 5aff3d17-fbd9-4e8e-b357-c65caa101acf of volume 1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:40:37 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4d01d9-a02d-4ae9-9fcf-a65a05eade13]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:37 devstack sudo[98796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e
Sep 08 16:40:37 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:38 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" returned: 0 in 0.501s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:38 devstack sudo[98801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf 1G
Sep 08 16:40:38 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:38 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf 1G" returned: 0 in 0.602s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:38 devstack sudo[98808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf
Sep 08 16:40:38 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:39 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf" returned: 0 in 0.450s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:39 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf is being set with open permissions: ugo+rw
Sep 08 16:40:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:39 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf
Sep 08 16:40:39 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:39 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf" returned: 0 in 0.275s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:39 devstack sudo[98817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.info
Sep 08 16:40:39 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:40 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.info" returned: 0 in 0.394s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:40 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.info is being set with open permissions: ugo+rw
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:40 devstack sudo[98820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.info
Sep 08 16:40:40 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Flow 'volume_create_manager' (3ae2b204-dbef-45fa-9f14-5d4828bc3a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ff6de6-a652-4849-aac0-2a43da83379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ff6de6-a652-4849-aac0-2a43da83379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2107103536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9307b476-1667-4c10-bfbb-23298e03ffcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa5eba60a9140eba6a3c7d0deaf1410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:40Z,use_quota=True,user_id='7986463f0701444487ec6d035f54ef07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e8a88a-b279-4f48-8b60-d25988476794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e8a88a-b279-4f48-8b60-d25988476794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216283a5-7e0f-408c-ac80-2bcce88e1e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216283a5-7e0f-408c-ac80-2bcce88e1e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9307b476-1667-4c10-bfbb-23298e03ffcc', 'volume_name': 'volume-9307b476-1667-4c10-bfbb-23298e03ffcc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7101de4f-0436-4fe9-b07f-6c0b1e69f9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:40 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7101de4f-0436-4fe9-b07f-6c0b1e69f9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d147eb-b81b-4f5d-ba86-44a77241944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:40 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Volume 9307b476-1667-4c10-bfbb-23298e03ffcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9307b476-1667-4c10-bfbb-23298e03ffcc', 'volume_size': 1}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.info" returned: 0 in 0.341s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.689s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2107103536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9307b476-1667-4c10-bfbb-23298e03ffcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa5eba60a9140eba6a3c7d0deaf1410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:40Z,use_quota=True,user_id='7986463f0701444487ec6d035f54ef07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Creating volume 9307b476-1667-4c10-bfbb-23298e03ffcc {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:40 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:40 devstack sudo[98823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc 1073741824
Sep 08 16:40:40 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b0973655-6712-4ea9-afb9-79e2f22ab054 tempest-VolumesSnapshotTestJSON-1721620290 None] Create snapshot completed successfully
Sep 08 16:40:41 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc 1073741824" returned: 0 in 0.623s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-5aff3d17-fbd9-4e8e-b357-c65caa101acf-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:41 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc
Sep 08 16:40:41 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-5aff3d17-fbd9-4e8e-b357-c65caa101acf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-5aff3d17-fbd9-4e8e-b357-c65caa101acf" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-5aff3d17-fbd9-4e8e-b357-c65caa101acf" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Deleting offline snapshot 5aff3d17-fbd9-4e8e-b357-c65caa101acf of volume 1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] snapshot_file for this snap is: volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2236f8-d7a6-44d1-8b51-d5aa485a4990]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:41 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc" returned: 0 in 0.330s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d147eb-b81b-4f5d-ba86-44a77241944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9307b476-1667-4c10-bfbb-23298e03ffcc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6a8d68-e3e8-4b48-9df6-4576232f714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:41 devstack sudo[98831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf
Sep 08 16:40:41 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:41 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Volume volume-9307b476-1667-4c10-bfbb-23298e03ffcc (9307b476-1667-4c10-bfbb-23298e03ffcc): created successfully
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6a8d68-e3e8-4b48-9df6-4576232f714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Flow 'volume_create_manager' (3ae2b204-dbef-45fa-9f14-5d4828bc3a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e8b59edf-41df-495a-87e3-057995d6a303 tempest-AbsoluteLimitsTests-162984451 None] Created volume successfully.
Sep 08 16:40:41 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf" returned: 0 in 0.438s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f8837f-fd4e-42df-b122-cea152d0c05b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:41 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e
Sep 08 16:40:41 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:42 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" returned: 0 in 0.418s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:42 devstack sudo[98843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf
Sep 08 16:40:42 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:42 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf" returned: 0 in 0.596s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:42 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf
Sep 08 16:40:42 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Acquiring lock "cinder-9307b476-1667-4c10-bfbb-23298e03ffcc-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Lock "cinder-9307b476-1667-4c10-bfbb-23298e03ffcc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Acquiring lock "cinder-quobyte-9307b476-1667-4c10-bfbb-23298e03ffcc" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Lock "cinder-quobyte-9307b476-1667-4c10-bfbb-23298e03ffcc" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd70b0-60f6-477b-923b-f274edefca35]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:43 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e.5aff3d17-fbd9-4e8e-b357-c65caa101acf" returned: 0 in 0.378s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-5aff3d17-fbd9-4e8e-b357-c65caa101acf" released by "_delete_snapshot" :: held 2.029s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" released by "delete_snapshot" :: held 2.092s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:43 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc
Sep 08 16:40:43 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['e1c0b8b5-11d0-4d9f-ae13-c34427b6671f', '3b0cca5e-ae24-4a03-887d-6cb0348b1b19', 'b8ba6315-273f-42b1-b7bc-1ff07ad6cc88', '16c92406-6cb9-4bf7-bf29-3d2500ca2364'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:43 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Delete snapshot completed successfully.
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2146c912-8ec8-41f9-9e5b-9c24809b8732 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-5aff3d17-fbd9-4e8e-b357-c65caa101acf-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:43 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc" returned: 0 in 0.542s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:43 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc
Sep 08 16:40:43 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:44 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9307b476-1667-4c10-bfbb-23298e03ffcc" returned: 0 in 0.465s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Lock "cinder-quobyte-9307b476-1667-4c10-bfbb-23298e03ffcc" released by "delete_volume" :: held 1.087s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Created reservations ['3cbe7424-39f8-4e73-9df2-fcfa294a5ccf', 'df9b303b-979e-4bf7-b91e-9a9dd4cba840', 'c21bbcb5-eec2-408b-aafa-dd002db267d8', '4c5b7447-7be8-4ba5-a145-c0b3a9b03595'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Flow 'volume_create_manager' (094dfea8-1d51-460a-803d-c57d357374a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982caf74-b66c-4170-920e-ca79498e819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982caf74-b66c-4170-920e-ca79498e819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1259658747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554301e1-d5f1-4bed-a843-f1e49e6a7d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac934d244f44d6ba9ae06cf522be186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:44Z,use_quota=True,user_id='70b4b0f0de954fe5a696778e3b47d2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf7ac97-48c4-4a02-ac59-6e0140590302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf7ac97-48c4-4a02-ac59-6e0140590302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928597e8-9271-455a-8925-898f84f7f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928597e8-9271-455a-8925-898f84f7f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554301e1-d5f1-4bed-a843-f1e49e6a7d5b', 'volume_name': 'volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e29dc0-4556-41c2-a940-0bddd7cc5b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e29dc0-4556-41c2-a940-0bddd7cc5b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c770a419-4571-45b1-bc69-286a334e645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:44 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Volume 554301e1-d5f1-4bed-a843-f1e49e6a7d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b', 'volume_size': 1}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1259658747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554301e1-d5f1-4bed-a843-f1e49e6a7d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cac934d244f44d6ba9ae06cf522be186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:44Z,use_quota=True,user_id='70b4b0f0de954fe5a696778e3b47d2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Creating volume 554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:44 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:44 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b 1073741824
Sep 08 16:40:44 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:44 devstack sudo[98863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:44 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:44 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.313s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:44 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Deleted volume successfully.
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-301a45fe-5bf5-4d9d-9c7f-453db1c71733 tempest-AbsoluteLimitsTests-162984451 None] Lock "cinder-9307b476-1667-4c10-bfbb-23298e03ffcc-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:44 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (e06454b8-7b60-4ee3-b929-e480e732d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813a763c-3a05-46dc-a01a-a45cb5e75f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b 1073741824" returned: 0 in 0.626s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (813a763c-3a05-46dc-a01a-a45cb5e75f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1299375058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dbac16-217d-4623-a9c9-43cf3458db87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:45Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c670b36-4006-4d2b-8beb-8857885fef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c670b36-4006-4d2b-8beb-8857885fef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050c0e02-e44b-4f3e-8b11-3c8e50060ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050c0e02-e44b-4f3e-8b11-3c8e50060ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58dbac16-217d-4623-a9c9-43cf3458db87', 'volume_name': 'volume-58dbac16-217d-4623-a9c9-43cf3458db87', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a45ba6a-21c2-4a64-b712-1b383b6c5067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a45ba6a-21c2-4a64-b712-1b383b6c5067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7505fb0-3ebd-49d0-b0de-fb64736aa001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:45 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Volume 58dbac16-217d-4623-a9c9-43cf3458db87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58dbac16-217d-4623-a9c9-43cf3458db87', 'volume_size': 1}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:45 devstack sudo[98870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b
Sep 08 16:40:45 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:45 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" returned: 0 in 0.292s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1299375058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58dbac16-217d-4623-a9c9-43cf3458db87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:45Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Creating volume 58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:45 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c770a419-4571-45b1-bc69-286a334e645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:45 devstack sudo[98873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 1073741824
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2c4dc4-5d7c-4ba4-b40a-ee4d90e0cca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:45 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:45 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Volume volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b (554301e1-d5f1-4bed-a843-f1e49e6a7d5b): created successfully
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db2c4dc4-5d7c-4ba4-b40a-ee4d90e0cca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Flow 'volume_create_manager' (094dfea8-1d51-460a-803d-c57d357374a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:45 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-c09ef415-0db1-4d07-a1d9-30b0e79bde44 req-ab428183-cdfc-4e75-814d-9f9715c48e70 tempest-VolumesSnapshotsTestJSON-774169155 None] Created volume successfully.
Sep 08 16:40:45 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 1073741824" returned: 0 in 0.564s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:45 devstack sudo[98879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87
Sep 08 16:40:45 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:46 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87" returned: 0 in 0.284s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7505fb0-3ebd-49d0-b0de-fb64736aa001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58dbac16-217d-4623-a9c9-43cf3458db87', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719dc31f-a7ad-4ae9-a5fb-37602598af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:46 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Volume volume-58dbac16-217d-4623-a9c9-43cf3458db87 (58dbac16-217d-4623-a9c9-43cf3458db87): created successfully
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719dc31f-a7ad-4ae9-a5fb-37602598af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (e06454b8-7b60-4ee3-b929-e480e732d998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:46 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-af001aef-c1f6-429a-a4f8-307e2c28cd97 tempest-VolumesSnapshotTestJSON-1721620290 None] Created volume successfully.
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Creating offline snapshot 3d45bc43-577e-46c1-a30f-5dfcc22e16fb of volume 554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1146deda-6246-4030-b5b5-df2d096f9db0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:46 devstack sudo[98882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b
Sep 08 16:40:46 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:47 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" returned: 0 in 0.552s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:47 devstack sudo[98887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb 1G
Sep 08 16:40:47 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:47 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb 1G" returned: 0 in 0.480s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:47 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb
Sep 08 16:40:47 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:48 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb" returned: 0 in 0.353s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:48 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb is being set with open permissions: ugo+rw
Sep 08 16:40:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:48 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb
Sep 08 16:40:48 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:48 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb" returned: 0 in 0.290s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:48 devstack sudo[98902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.info
Sep 08 16:40:48 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:48 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.info" returned: 0 in 0.293s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:48 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.info is being set with open permissions: ugo+rw
Sep 08 16:40:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:48 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.info
Sep 08 16:40:48 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:49 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.info" returned: 0 in 0.308s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.799s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Creating offline snapshot 711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 of volume 58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:40:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-7d109361-1166-4b28-940f-1764a5125c5e req-a107f9c6-140d-46e6-be7a-bf122409053c tempest-VolumesSnapshotsTestJSON-774169155 None] Create snapshot completed successfully
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba4565-4759-4893-82e9-bb307f60e102]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:49 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87
Sep 08 16:40:49 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "cinder-3d45bc43-577e-46c1-a30f-5dfcc22e16fb-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:49 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-3d45bc43-577e-46c1-a30f-5dfcc22e16fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "cinder-quobyte-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87" returned: 0 in 0.503s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-quobyte-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" acquired by "delete_snapshot" :: waited 0.082s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:49 devstack sudo[98913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 1G
Sep 08 16:40:49 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "cinder-quobyte-3d45bc43-577e-46c1-a30f-5dfcc22e16fb" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-quobyte-3d45bc43-577e-46c1-a30f-5dfcc22e16fb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Deleting offline snapshot 3d45bc43-577e-46c1-a30f-5dfcc22e16fb of volume 554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] snapshot_file for this snap is: volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657f37e-6185-4614-a001-3f46a0e85b6e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:49 devstack sudo[98915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb
Sep 08 16:40:49 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:50 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 1G" returned: 0 in 0.521s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dbac16-217d-4623-a9c9-43cf3458db87 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:50 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb" returned: 0 in 0.445s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:40:50 devstack sudo[98925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dbac16-217d-4623-a9c9-43cf3458db87 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5
Sep 08 16:40:50 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[06027cd9-d1bf-49be-8737-0419d6ddb875]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:50 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b
Sep 08 16:40:50 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:50 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58dbac16-217d-4623-a9c9-43cf3458db87 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" returned: 0 in 0.422s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:50 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 is being set with open permissions: ugo+rw
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:50 devstack sudo[98932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5
Sep 08 16:40:50 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:50 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" returned: 0 in 0.593s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:50 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb
Sep 08 16:40:50 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:51 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" returned: 0 in 0.396s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:51 devstack sudo[98941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.info
Sep 08 16:40:51 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:51 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb" returned: 0 in 0.506s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:51 devstack sudo[98946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb
Sep 08 16:40:51 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:51 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.info" returned: 0 in 0.368s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:51 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.info is being set with open permissions: ugo+rw
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:51 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.info
Sep 08 16:40:51 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:51 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b.3d45bc43-577e-46c1-a30f-5dfcc22e16fb" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-quobyte-3d45bc43-577e-46c1-a30f-5dfcc22e16fb" released by "_delete_snapshot" :: held 1.988s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-quobyte-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" released by "delete_snapshot" :: held 2.022s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:51 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.info" returned: 0 in 0.307s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a092f3d9-5ad0-4a9e-9459-8754766f68f8 tempest-VolumesSnapshotTestJSON-1721620290 None] Create snapshot completed successfully
Sep 08 16:40:51 devstack cinder-volume[87505]: DEBUG cinder.quota [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Created reservations ['cdccc02e-309c-4047-92f7-f3d28e156f7c', '47c88e3f-44b2-47ee-9302-d556b5349c7e', 'e678e4ee-aa8f-4673-9b70-8bc3bc15b583', '67aab408-4fc3-4faa-b946-8775a35177e7'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Delete snapshot completed successfully.
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-db9fd50f-cab5-4498-8052-d7172957f9dc req-02141da5-b1e1-41d6-b35e-7650983577a6 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-3d45bc43-577e-46c1-a30f-5dfcc22e16fb-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Flow 'volume_create_manager' (70cf19fa-6569-4760-9b88-3085ba98a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c02b2e8-27e9-4bee-8864-e7171f1299f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c02b2e8-27e9-4bee-8864-e7171f1299f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1162722221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c19f47-846a-4f1a-8286-5a8c0577baf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbc7b5b59454bb393bbe7b67601f7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:52Z,use_quota=True,user_id='1bad90874178419e86eac96eca399653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5ffff1-bcb5-4c7d-8910-9f8e87ba0799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5ffff1-bcb5-4c7d-8910-9f8e87ba0799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61a660c-07eb-4cc3-a031-9d5e912d9bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61a660c-07eb-4cc3-a031-9d5e912d9bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c19f47-846a-4f1a-8286-5a8c0577baf9', 'volume_name': 'volume-56c19f47-846a-4f1a-8286-5a8c0577baf9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd4a556-e04d-48b3-90ac-2a6f106c192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd4a556-e04d-48b3-90ac-2a6f106c192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fae1d2-ceab-484d-8f14-ad6fdbc8acd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Volume 56c19f47-846a-4f1a-8286-5a8c0577baf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c19f47-846a-4f1a-8286-5a8c0577baf9', 'volume_size': 1}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1162722221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c19f47-846a-4f1a-8286-5a8c0577baf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cbc7b5b59454bb393bbe7b67601f7e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:52Z,use_quota=True,user_id='1bad90874178419e86eac96eca399653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Creating volume 56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:52 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:52 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 1073741824
Sep 08 16:40:52 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:52 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 1073741824" returned: 0 in 0.479s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:52 devstack sudo[98959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9
Sep 08 16:40:52 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "cinder-554301e1-d5f1-4bed-a843-f1e49e6a7d5b-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-554301e1-d5f1-4bed-a843-f1e49e6a7d5b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "cinder-quobyte-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-quobyte-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" acquired by "delete_volume" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:53 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9" returned: 0 in 0.513s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[54227b48-5dc7-4b4c-a254-7a8f5e972319]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2fae1d2-ceab-484d-8f14-ad6fdbc8acd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c19f47-846a-4f1a-8286-5a8c0577baf9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a182ef8-f2db-4a43-b471-a935ca2b9939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Volume volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 (56c19f47-846a-4f1a-8286-5a8c0577baf9): created successfully
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a182ef8-f2db-4a43-b471-a935ca2b9939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Flow 'volume_create_manager' (70cf19fa-6569-4760-9b88-3085ba98a12e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-15cce077-32c1-4a5c-ad8e-29ea77469b56 tempest-VolumesSnapshotListTestJSON-1118169108 None] Created volume successfully.
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:40:53 devstack sudo[98996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b
Sep 08 16:40:53 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (9d7a078a-01e3-4ced-8c92-20d65580a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91666b09-c283-47c9-82d4-ca7a63b8aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91666b09-c283-47c9-82d4-ca7a63b8aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-862320717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce39278-7d27-49cd-8238-1d06b3198867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:40:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:40:53Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cd122b-9614-46d1-b88b-5a3fd20c5c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cd122b-9614-46d1-b88b-5a3fd20c5c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55fb37e-4336-46d2-a9ec-ba06b84eeb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c55fb37e-4336-46d2-a9ec-ba06b84eeb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ce39278-7d27-49cd-8238-1d06b3198867', 'volume_name': 'volume-4ce39278-7d27-49cd-8238-1d06b3198867', 'volume_size': 2, 'snapshot_id': '711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d595c-df12-4806-bc9b-dd76dc498efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8d595c-df12-4806-bc9b-dd76dc498efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d34a1b-ffb1-4566-9b8a-78a953ff3a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:40:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Volume 4ce39278-7d27-49cd-8238-1d06b3198867: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ce39278-7d27-49cd-8238-1d06b3198867', 'volume_size': 2, 'snapshot_id': '711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5'}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5-4ce39278-7d27-49cd-8238-1d06b3198867" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5-4ce39278-7d27-49cd-8238-1d06b3198867" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Creating volume 4ce39278-7d27-49cd-8238-1d06b3198867 from snapshot 711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-4ce39278-7d27-49cd-8238-1d06b3198867" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-4ce39278-7d27-49cd-8238-1d06b3198867" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] snapshot: 711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5, volume: 4ce39278-7d27-49cd-8238-1d06b3198867,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7f3055-9f9c-4387-807c-4b385e048c62]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:53 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" returned: 0 in 0.518s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:53 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b
Sep 08 16:40:53 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:53 devstack sudo[99005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5
Sep 08 16:40:53 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:54 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" returned: 0 in 0.267s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-quobyte-554301e1-d5f1-4bed-a843-f1e49e6a7d5b" released by "delete_volume" :: held 0.935s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.quota [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Created reservations ['ed5b43fa-8a5a-4fbe-93bf-a8d6a95c4d5b', '3a35db77-f0af-4c38-826c-35f4daac4c87', '6c9eb2b2-1113-44aa-8ee4-1d9e86b08648', '34702a4e-e85f-48bf-be42-28d57384801e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:40:54 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" returned: 0 in 0.408s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dbac16-217d-4623-a9c9-43cf3458db87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3ed061-d5a2-42fd-a4f3-f2aa2649c7e5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:54 devstack sudo[99014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87
Sep 08 16:40:54 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:54 devstack sudo[99015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:54 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:54 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87" returned: 0 in 0.482s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:54 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867
Sep 08 16:40:54 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:54 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.464s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.manager [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Deleted volume successfully.
Sep 08 16:40:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-74bdf603-71eb-456f-bc9c-77c6d3e5f9cd req-da286116-3014-4ce4-bda2-be55bec66762 tempest-VolumesSnapshotsTestJSON-774169155 None] Lock "cinder-554301e1-d5f1-4bed-a843-f1e49e6a7d5b-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:40:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:40:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:40:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:40:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:40:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:40:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:40:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:56 devstack sudo[99034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:40:56 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:57 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.684s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:40:57 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:40:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:40:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:40:59 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867" returned: 0 in 4.943s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:59 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:40:59 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Converted 1024.00 MB image at 207.06 MB/s
Sep 08 16:40:59 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867 is being set with open permissions: ugo+rw
Sep 08 16:40:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:40:59 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867
Sep 08 16:40:59 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:40:59 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Sep 08 16:40:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867" returned: 0 in 0.291s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:40:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-4ce39278-7d27-49cd-8238-1d06b3198867" released by "_copy_volume_from_snapshot" :: held 6.228s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5-4ce39278-7d27-49cd-8238-1d06b3198867" released by "_create_volume_from_snapshot" :: held 6.325s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.353s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.276s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Creating offline snapshot e44dc315-78b3-4aff-9bfd-44b3d1a53e29 of volume 56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d34a1b-ffb1-4566-9b8a-78a953ff3a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce39278-7d27-49cd-8238-1d06b3198867', 'volume_size': 2, 'snapshot_id': '711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8fcdd7-9297-4337-a014-74b37c629b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf46e2ff-72d9-4567-b3d1-7eef7570948f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:00 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Volume volume-4ce39278-7d27-49cd-8238-1d06b3198867 (4ce39278-7d27-49cd-8238-1d06b3198867): created successfully
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac8fcdd7-9297-4337-a014-74b37c629b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (9d7a078a-01e3-4ced-8c92-20d65580a581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-24199f5d-25a6-4890-bd4e-6ab7aa29bd68 tempest-VolumesSnapshotTestJSON-1721620290 None] Created volume successfully.
Sep 08 16:41:00 devstack sudo[99040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9
Sep 08 16:41:00 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:00 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9" returned: 0 in 0.479s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:00 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 1G
Sep 08 16:41:00 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-4ce39278-7d27-49cd-8238-1d06b3198867-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-4ce39278-7d27-49cd-8238-1d06b3198867-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-4ce39278-7d27-49cd-8238-1d06b3198867" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-4ce39278-7d27-49cd-8238-1d06b3198867" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138bba0-2e38-4881-aab7-834872c0fb37]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:00 devstack sudo[99047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867
Sep 08 16:41:00 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:01 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 1G" returned: 0 in 0.543s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:01 devstack sudo[99056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29
Sep 08 16:41:01 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:01 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867" returned: 0 in 0.456s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:01 devstack sudo[99059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867
Sep 08 16:41:01 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:01 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29" returned: 0 in 0.382s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:01 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 is being set with open permissions: ugo+rw
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:01 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4ce39278-7d27-49cd-8238-1d06b3198867" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:01 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29
Sep 08 16:41:01 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-4ce39278-7d27-49cd-8238-1d06b3198867" released by "delete_volume" :: held 0.831s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['84e45624-c637-4322-a690-f33d358f0485', '01be9114-5af8-4045-be80-3d8507043e40', '453639e8-5ab2-4bf8-8c0e-f9357aee97a8', '9ab81654-1991-4f34-ac3c-41fe44829543'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:01 devstack sudo[99067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:01 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:01 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29" returned: 0 in 0.353s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:01 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.info
Sep 08 16:41:01 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-58dbac16-217d-4623-a9c9-43cf3458db87" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-58dbac16-217d-4623-a9c9-43cf3458db87" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Deleting offline snapshot 711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 of volume 58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] snapshot_file for this snap is: volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[82852a05-f955-4646-98db-a3132ccce00f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:02 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.389s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Deleted volume successfully.
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-76b1592d-010f-4fd2-a028-3b3ec49e14b9 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-4ce39278-7d27-49cd-8238-1d06b3198867-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:02 devstack sudo[99073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5
Sep 08 16:41:02 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:02 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.info" returned: 0 in 0.411s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:02 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.info is being set with open permissions: ugo+rw
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:02 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.info
Sep 08 16:41:02 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:02 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" returned: 0 in 0.445s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58dbac16-217d-4623-a9c9-43cf3458db87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2137f9eb-f0ed-467b-830e-e59691ee61dd]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:02 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.info" returned: 0 in 0.300s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-28ef2e0e-33bb-41e0-92b8-599c53103bd0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Create snapshot completed successfully
Sep 08 16:41:02 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87
Sep 08 16:41:02 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:03 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87" returned: 0 in 0.582s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:03 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5
Sep 08 16:41:03 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:03 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" returned: 0 in 0.438s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:03 devstack sudo[99098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5
Sep 08 16:41:03 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Creating offline snapshot b2eb1853-9a58-430c-8070-9ac04aed1ecb of volume 56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52a78e7-1fb1-4620-83e1-819a4786407f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-81657f23-57b9-40b4-b33e-77ebe6db59e8 tempest-GroupSnapshotsTest-783420116 None] Group tempest-GroupSnapshotsTest-Group-466275213: creating
Sep 08 16:41:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-81657f23-57b9-40b4-b33e-77ebe6db59e8 tempest-GroupSnapshotsTest-783420116 None] Group tempest-GroupSnapshotsTest-Group-466275213: created successfully
Sep 08 16:41:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-81657f23-57b9-40b4-b33e-77ebe6db59e8 tempest-GroupSnapshotsTest-783420116 None] Create group completed successfully.
Sep 08 16:41:03 devstack sudo[99100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29
Sep 08 16:41:03 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:03 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87.711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5" released by "_delete_snapshot" :: held 1.934s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-58dbac16-217d-4623-a9c9-43cf3458db87" released by "delete_snapshot" :: held 1.959s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:04 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['c89a8e1c-caf2-4e67-8c7a-49ba55c6548e', '37c12765-b0af-48b6-8f89-c14bb76c6846', 'b811c580-63be-4381-8984-8ceda62dea38', '42c7ba61-fbbb-4cf9-b50a-a42921f7c02f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:04 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Delete snapshot completed successfully.
Sep 08 16:41:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8f4457af-d955-4e57-9437-4ba40a7d997f tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-711e3d64-a667-49c1-a7cb-0c8f4f0ea1f5-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:04 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29" returned: 0 in 0.440s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c19f47-846a-4f1a-8286-5a8c0577baf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:04 devstack sudo[99106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb 1G
Sep 08 16:41:04 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:04 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb 1G" returned: 0 in 0.512s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:04 devstack sudo[99112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb
Sep 08 16:41:04 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:05 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb" returned: 0 in 0.414s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:05 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb is being set with open permissions: ugo+rw
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:05 devstack sudo[99124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb
Sep 08 16:41:05 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-58dbac16-217d-4623-a9c9-43cf3458db87-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-58dbac16-217d-4623-a9c9-43cf3458db87-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-58dbac16-217d-4623-a9c9-43cf3458db87" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-58dbac16-217d-4623-a9c9-43cf3458db87" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f90b188-7a3b-4930-b3ab-69e3d898e27a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:05 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb" returned: 0 in 0.534s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:05 devstack sudo[99134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87
Sep 08 16:41:05 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.125s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-031b4869-07a6-4f83-ac1b-f5f61c0974f7 tempest-VolumesSnapshotListTestJSON-1118169108 None] Create snapshot completed successfully
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (777849f9-9c6d-4f0c-9c37-ca63fd01d7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8218e771-ff5e-49f3-9710-6d3efb01ab2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8218e771-ff5e-49f3-9710-6d3efb01ab2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436308305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f48713d2-e379-483b-8eb4-9ca61961dfa8,host='devstack@QuobyteHD#QuobyteHD',id=5c214397-6a8d-46c6-b693-6afa7006446b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:06Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53751971-3cd3-40ad-9aa1-403fb5ec8c7f),volume_type_id=53751971-3cd3-40ad-9aa1-403fb5ec8c7f)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1529137e-f3d7-4a9e-9315-d83021e7386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1529137e-f3d7-4a9e-9315-d83021e7386f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3837f39-2798-4ea9-bec4-5c339d0f878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3837f39-2798-4ea9-bec4-5c339d0f878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c214397-6a8d-46c6-b693-6afa7006446b', 'volume_name': 'volume-5c214397-6a8d-46c6-b693-6afa7006446b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37a75cd-a358-4f68-9301-d556417ca203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37a75cd-a358-4f68-9301-d556417ca203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc02090-5ae9-4c5f-a799-e30f58260284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:05 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Volume 5c214397-6a8d-46c6-b693-6afa7006446b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c214397-6a8d-46c6-b693-6afa7006446b', 'volume_size': 1}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f48713d2-e379-483b-8eb4-9ca61961dfa8,created_at=2026-09-08T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1436308305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f48713d2-e379-483b-8eb4-9ca61961dfa8,host='devstack@QuobyteHD#QuobyteHD',id=5c214397-6a8d-46c6-b693-6afa7006446b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:06Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53751971-3cd3-40ad-9aa1-403fb5ec8c7f),volume_type_id=53751971-3cd3-40ad-9aa1-403fb5ec8c7f)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Creating volume 5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:06 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:06 devstack sudo[99138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b 1073741824
Sep 08 16:41:06 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:06 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87" returned: 0 in 0.486s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:06 devstack sudo[99143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87
Sep 08 16:41:06 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:06 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-58dbac16-217d-4623-a9c9-43cf3458db87" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-58dbac16-217d-4623-a9c9-43cf3458db87" released by "delete_volume" :: held 0.899s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['89ebfd64-cad9-424a-bd0a-55707c93c69d', '9e7164d6-8c90-4d38-a7b6-4210a8540576', '51a3c00e-0966-4189-9788-146ee1272db8', '830208c6-ddbc-4dfe-a253-950ac1bc3343'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:06 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b 1073741824" returned: 0 in 0.486s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:06 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b
Sep 08 16:41:06 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:06 devstack sudo[99152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:06 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:06 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:06 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b" returned: 0 in 0.274s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Deleted volume successfully.
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bc02090-5ae9-4c5f-a799-e30f58260284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c214397-6a8d-46c6-b693-6afa7006446b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ae4f56-b410-4738-9901-0754e5c13948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7aa97309-7e60-4443-ab16-72742acdec88 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-58dbac16-217d-4623-a9c9-43cf3458db87-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:06 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Volume volume-5c214397-6a8d-46c6-b693-6afa7006446b (5c214397-6a8d-46c6-b693-6afa7006446b): created successfully
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ae4f56-b410-4738-9901-0754e5c13948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (777849f9-9c6d-4f0c-9c37-ca63fd01d7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ead8e5a2-369d-4b85-8eab-b786eab4c890 tempest-GroupSnapshotsTest-783420116 None] Created volume successfully.
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Creating offline snapshot f4bd4264-6284-493b-98b0-c0fc4caa54e9 of volume 56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275ddba-e343-465e-b3e5-e61b16ca54ac]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:07 devstack sudo[99157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb
Sep 08 16:41:07 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] GroupSnapshot 7933ec94-0111-4109-8c20-b9c3331fa51b: creating.
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Group snapshot 7933ec94-0111-4109-8c20-b9c3331fa51b: creating. {{(pid=87505) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:07 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb" returned: 0 in 0.464s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c19f47-846a-4f1a-8286-5a8c0577baf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:07 devstack sudo[99162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 1G
Sep 08 16:41:07 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:08 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 1G" returned: 0 in 1.015s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:08 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9
Sep 08 16:41:08 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (083ec644-046a-4af2-a55a-9bfd11ec9167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe79087-2a44-435b-a4a6-cc43ebd4e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe79087-2a44-435b-a4a6-cc43ebd4e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1439718461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba2e225-e302-4c9a-b929-89febb59bcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:09Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c0cf9d-f2df-4e54-af4a-e38036c9062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67c0cf9d-f2df-4e54-af4a-e38036c9062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a1e23a-9e3f-457e-bce1-9e6b22813e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a1e23a-9e3f-457e-bce1-9e6b22813e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba2e225-e302-4c9a-b929-89febb59bcbd', 'volume_name': 'volume-dba2e225-e302-4c9a-b929-89febb59bcbd', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c61b59c-8a95-4246-a638-b9694a3b0bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c61b59c-8a95-4246-a638-b9694a3b0bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7944e4a-4b2e-4b1f-8e41-9186418d19c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:08 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Volume dba2e225-e302-4c9a-b929-89febb59bcbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba2e225-e302-4c9a-b929-89febb59bcbd', 'volume_size': 1}
Sep 08 16:41:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:08 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9" returned: 0 in 0.358s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:09 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 is being set with open permissions: ugo+rw
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:09 devstack sudo[99243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9
Sep 08 16:41:09 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:09 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9" returned: 0 in 0.259s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.778s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Creating offline snapshot e12ab8c6-7e37-4180-b186-4ce153f653ff of volume 5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4821d7-e29a-4280-a6c7-a72d3eeb26fd]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:09 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0846c939-ce66-4dc0-bd5f-08f5472540b0 tempest-VolumesSnapshotListTestJSON-1118169108 None] Create snapshot completed successfully
Sep 08 16:41:09 devstack sudo[99249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b
Sep 08 16:41:09 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:09 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b" returned: 0 in 0.454s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:09 devstack sudo[99256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff 1G
Sep 08 16:41:09 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:10 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff 1G" returned: 0 in 0.405s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c214397-6a8d-46c6-b693-6afa7006446b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:10 devstack sudo[99262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c214397-6a8d-46c6-b693-6afa7006446b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff
Sep 08 16:41:10 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:10 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c214397-6a8d-46c6-b693-6afa7006446b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff" returned: 0 in 0.343s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:10 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:41:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:10 devstack sudo[99267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff
Sep 08 16:41:10 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:10 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff" returned: 0 in 0.289s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:10 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.info
Sep 08 16:41:10 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:11 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.info" returned: 0 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:11 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:11 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.info
Sep 08 16:41:11 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-f4bd4264-6284-493b-98b0-c0fc4caa54e9-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-f4bd4264-6284-493b-98b0-c0fc4caa54e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-quobyte-f4bd4264-6284-493b-98b0-c0fc4caa54e9" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-f4bd4264-6284-493b-98b0-c0fc4caa54e9" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Deleting offline snapshot f4bd4264-6284-493b-98b0-c0fc4caa54e9 of volume 56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] snapshot_file for this snap is: volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea06727b-9a57-4617-827f-485790251e43]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:11 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.info" returned: 0 in 0.364s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:11 devstack sudo[99275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.740s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:11 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1439718461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba2e225-e302-4c9a-b929-89febb59bcbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:09Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Creating volume dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:11 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:11 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd 1073741824
Sep 08 16:41:11 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:11 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f098b497-7f52-4629-91f9-86d492ae85cd tempest-GroupSnapshotsTest-783420116 None] group_snapshot 7933ec94-0111-4109-8c20-b9c3331fa51b: created successfully
Sep 08 16:41:11 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9" returned: 0 in 0.525s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c19f47-846a-4f1a-8286-5a8c0577baf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a550114f-4139-4360-b82b-051a93b31ec0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:12 devstack sudo[99284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb
Sep 08 16:41:12 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:12 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd 1073741824" returned: 0 in 0.910s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:12 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb" returned: 0 in 0.575s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c19f47-846a-4f1a-8286-5a8c0577baf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:12 devstack sudo[99293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd
Sep 08 16:41:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:12 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:12 devstack sudo[99295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9
Sep 08 16:41:12 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:12 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd" returned: 0 in 0.433s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7944e4a-4b2e-4b1f-8e41-9186418d19c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba2e225-e302-4c9a-b929-89febb59bcbd', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26faf3c-c4a6-47d7-be4d-9afe2c706ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:13 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Volume volume-dba2e225-e302-4c9a-b929-89febb59bcbd (dba2e225-e302-4c9a-b929-89febb59bcbd): created successfully
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26faf3c-c4a6-47d7-be4d-9afe2c706ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (083ec644-046a-4af2-a55a-9bfd11ec9167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:13 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-355552b2-1ee0-4519-b8ac-c01629a36c7d tempest-VolumesSnapshotTestJSON-1721620290 None] Created volume successfully.
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-e12ab8c6-7e37-4180-b186-4ce153f653ff-01222e1c-84ed-43b6-b7fb-7985433f24fd" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e12ab8c6-7e37-4180-b186-4ce153f653ff-01222e1c-84ed-43b6-b7fb-7985433f24fd" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Creating volume 01222e1c-84ed-43b6-b7fb-7985433f24fd from snapshot e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-01222e1c-84ed-43b6-b7fb-7985433f24fd" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-01222e1c-84ed-43b6-b7fb-7985433f24fd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] snapshot: e12ab8c6-7e37-4180-b186-4ce153f653ff, volume: 01222e1c-84ed-43b6-b7fb-7985433f24fd,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a141c752-f24a-4fb2-a7d3-60729ca4e89f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:13 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9" returned: 0 in 0.665s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:13 devstack sudo[99303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9
Sep 08 16:41:13 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:13 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff
Sep 08 16:41:13 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:13 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.f4bd4264-6284-493b-98b0-c0fc4caa54e9" returned: 0 in 0.372s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-f4bd4264-6284-493b-98b0-c0fc4caa54e9" released by "_delete_snapshot" :: held 2.288s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" released by "delete_snapshot" :: held 2.339s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:13 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff" returned: 0 in 0.479s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c214397-6a8d-46c6-b693-6afa7006446b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6711ad-001c-4f95-becc-851c2cea1fcc]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Created reservations ['2f3fac59-751c-4ec3-8a44-7e8e04f9b136', '8ec77caa-6c51-4f7a-9031-c7b6a9d9b89d', 'db4df1ec-e7af-4d9c-8a3a-97c08a7363d5', '5ee13e00-e51c-4e1e-b663-dd8630b0a8eb'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:13 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Delete snapshot completed successfully.
Sep 08 16:41:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c761f943-8645-4651-b094-be2960211df4 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-f4bd4264-6284-493b-98b0-c0fc4caa54e9-delete_snapshot" released by "delete_snapshot" :: held 2.531s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:13 devstack sudo[99311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b
Sep 08 16:41:13 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:14 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b" returned: 0 in 0.444s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:14 devstack sudo[99316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd
Sep 08 16:41:14 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-b2eb1853-9a58-430c-8070-9ac04aed1ecb-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-b2eb1853-9a58-430c-8070-9ac04aed1ecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-quobyte-b2eb1853-9a58-430c-8070-9ac04aed1ecb" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-b2eb1853-9a58-430c-8070-9ac04aed1ecb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Deleting offline snapshot b2eb1853-9a58-430c-8070-9ac04aed1ecb of volume 56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] snapshot_file for this snap is: volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[07417feb-bff1-4a9b-9f6e-489e68713355]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:14 devstack sudo[99322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb
Sep 08 16:41:14 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:15 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb" returned: 0 in 0.735s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c19f47-846a-4f1a-8286-5a8c0577baf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:15 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7bebf-f339-4e89-8c6b-1c56ba835bf7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:15 devstack sudo[99334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29
Sep 08 16:41:15 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:16 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29" returned: 0 in 0.897s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c19f47-846a-4f1a-8286-5a8c0577baf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:16 devstack sudo[99339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb
Sep 08 16:41:16 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:17 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb" returned: 0 in 0.988s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:17 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb
Sep 08 16:41:17 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:18 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.b2eb1853-9a58-430c-8070-9ac04aed1ecb" returned: 0 in 0.730s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-b2eb1853-9a58-430c-8070-9ac04aed1ecb" released by "_delete_snapshot" :: held 3.567s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" released by "delete_snapshot" :: held 3.632s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:18 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=128,cinder:UPDATE=117,cinder:INSERT=33,cinder:DELETE=11 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:41:18 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=108,cinder:INSERT=28,cinder:UPDATE=128,cinder:DELETE=11 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:41:18 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Created reservations ['d202ae1c-1584-4298-add6-405693071da7', '17ceecc9-3e07-4f7c-8634-d3d3f754c737', '3ec54672-6d3f-4018-bdd1-2b1a917269d5', '6383e336-63e9-4a45-81be-ffbc33489762'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Delete snapshot completed successfully.
Sep 08 16:41:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3e382ff6-73fe-4f99-b8da-8af7f2c3a754 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-b2eb1853-9a58-430c-8070-9ac04aed1ecb-delete_snapshot" released by "delete_snapshot" :: held 4.198s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-e44dc315-78b3-4aff-9bfd-44b3d1a53e29-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-e44dc315-78b3-4aff-9bfd-44b3d1a53e29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-quobyte-e44dc315-78b3-4aff-9bfd-44b3d1a53e29" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-e44dc315-78b3-4aff-9bfd-44b3d1a53e29" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Deleting offline snapshot e44dc315-78b3-4aff-9bfd-44b3d1a53e29 of volume 56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] snapshot_file for this snap is: volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e8f91-4df6-473e-8d97-990db9d0c795]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:19 devstack sudo[99347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29
Sep 08 16:41:19 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:20 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd" returned: 0 in 5.960s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:41:20 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Converted 1024.00 MB image at 171.79 MB/s
Sep 08 16:41:20 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:20 devstack sudo[99349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd
Sep 08 16:41:20 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:20 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29" returned: 0 in 0.739s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c19f47-846a-4f1a-8286-5a8c0577baf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49eda91-2609-465a-a802-e510feacc5ba]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:20 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd" returned: 0 in 0.276s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-01222e1c-84ed-43b6-b7fb-7985433f24fd" released by "_copy_volume_from_snapshot" :: held 7.264s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:20 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9
Sep 08 16:41:20 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e12ab8c6-7e37-4180-b186-4ce153f653ff-01222e1c-84ed-43b6-b7fb-7985433f24fd" released by "_create_volume_from_snapshot" :: held 7.353s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.379s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.182s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Creating offline snapshot dea142b1-272f-4947-8336-46283e329c7e of volume dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e1322-22b9-44cf-9326-e7bf5941641b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0ee6f4ab-baed-4161-b10b-4da38d5462ed tempest-GroupSnapshotsTest-783420116 None] Create group from source-snapshot-7933ec94-0111-4109-8c20-b9c3331fa51b completed successfully.
Sep 08 16:41:20 devstack sudo[99357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd
Sep 08 16:41:20 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:20 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9" returned: 0 in 0.399s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:20 devstack sudo[99362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29
Sep 08 16:41:20 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:21 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd" returned: 0 in 0.453s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:21 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e 1G
Sep 08 16:41:21 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:21 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29" returned: 0 in 0.425s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:21 devstack sudo[99373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29
Sep 08 16:41:21 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-01222e1c-84ed-43b6-b7fb-7985433f24fd" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-01222e1c-84ed-43b6-b7fb-7985433f24fd" acquired by "delete_volume" :: waited 0.039s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d50e6a-c552-49db-8444-8556067b72a5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:21 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:21 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9.e44dc315-78b3-4aff-9bfd-44b3d1a53e29" returned: 0 in 0.406s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e 1G" returned: 0 in 0.586s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba2e225-e302-4c9a-b929-89febb59bcbd -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:21 devstack sudo[99380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd
Sep 08 16:41:21 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:21 devstack sudo[99383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba2e225-e302-4c9a-b929-89febb59bcbd -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e
Sep 08 16:41:21 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-e44dc315-78b3-4aff-9bfd-44b3d1a53e29" released by "_delete_snapshot" :: held 2.232s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" released by "delete_snapshot" :: held 2.305s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Created reservations ['1393a034-9b24-4be5-a941-ebd83d1ee6d2', '28bb8636-98e0-42a1-9f43-a10cad748b49', '910e584d-ee48-46c4-97a3-d6c0bdc15532', 'bf0ec509-feaa-4a31-83a2-edd6c73454c9'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Delete snapshot completed successfully.
Sep 08 16:41:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c4d9d317-d521-4bf2-83ec-ea8d9a3bc628 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-e44dc315-78b3-4aff-9bfd-44b3d1a53e29-delete_snapshot" released by "delete_snapshot" :: held 2.612s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:22 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd" returned: 0 in 0.543s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:22 devstack sudo[99408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd
Sep 08 16:41:22 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:22 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba2e225-e302-4c9a-b929-89febb59bcbd -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e" returned: 0 in 0.459s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:22 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e is being set with open permissions: ugo+rw
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:22 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e
Sep 08 16:41:22 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:22 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01222e1c-84ed-43b6-b7fb-7985433f24fd" returned: 0 in 0.261s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-01222e1c-84ed-43b6-b7fb-7985433f24fd" released by "delete_volume" :: held 0.863s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:22 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['03cce055-0989-452a-84d9-9f63359b9344'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:22 devstack cinder-volume[87505]: WARNING cinder.quota [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-245147402 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-245147402, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:41:22 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.info
Sep 08 16:41:22 devstack cinder-volume[87505]: WARNING cinder.quota [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-245147402 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-245147402, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:41:22 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['f2b65a63-8db4-41bb-9c56-a9a3653c6b3e', 'ec164afa-150e-4faa-bf2d-e6e486d2ecb3', 'ad0a5be9-11b0-418b-af1a-318becc23dde', 'f515d4af-0069-486c-939f-f2fcf2181988'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:22 devstack sudo[99416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:22 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-56c19f47-846a-4f1a-8286-5a8c0577baf9-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:22 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-56c19f47-846a-4f1a-8286-5a8c0577baf9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.info" returned: 0 in 0.305s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:22 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.info is being set with open permissions: ugo+rw
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:22 devstack sudo[99419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.info
Sep 08 16:41:22 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] group_snapshot 7933ec94-0111-4109-8c20-b9c3331fa51b: deleting
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:22 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.282s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e9aca1c7-5c5e-4bfc-af64-19d90d91a4a2 tempest-GroupSnapshotsTest-783420116 None] Delete group completed successfully.
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] group_snapshot 7933ec94-0111-4109-8c20-b9c3331fa51b: deleting {{(pid=87505) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef33138e-60fa-4745-a4ad-09c953dd0908]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-5c214397-6a8d-46c6-b693-6afa7006446b" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-5c214397-6a8d-46c6-b693-6afa7006446b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-e12ab8c6-7e37-4180-b186-4ce153f653ff" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e12ab8c6-7e37-4180-b186-4ce153f653ff" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Deleting offline snapshot e12ab8c6-7e37-4180-b186-4ce153f653ff of volume 5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] snapshot_file for this snap is: volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeac9347-98c5-4823-b110-adb85bf47854]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:22 devstack sudo[99422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9
Sep 08 16:41:22 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:23 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.info" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:23 devstack sudo[99423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff
Sep 08 16:41:23 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-462e96d1-788e-4555-8883-19970b820bff tempest-VolumesSnapshotTestJSON-1721620290 None] Create snapshot completed successfully
Sep 08 16:41:23 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9" returned: 0 in 0.410s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:23 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9
Sep 08 16:41:23 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:23 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff" returned: 0 in 0.396s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c214397-6a8d-46c6-b693-6afa7006446b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9536ded-2084-4ee2-af61-f25caee5a153]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:23 devstack sudo[99436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b
Sep 08 16:41:23 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:23 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56c19f47-846a-4f1a-8286-5a8c0577baf9" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-quobyte-56c19f47-846a-4f1a-8286-5a8c0577baf9" released by "delete_volume" :: held 0.728s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Created reservations ['3f77b0b0-492e-484f-94b3-7f57563480a1', '541e182e-061f-4201-8526-5c81b9fcbbff', 'ac6da1d5-289f-46c8-81b5-ebeb53f3ebb3', '42855da3-afa2-4354-b22f-7a95c3be9261'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:23 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:23 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (ebc8a6e8-4fda-48a5-bfbe-a34e3d569a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c527ff6f-01a5-480a-bb31-2867149495ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c527ff6f-01a5-480a-bb31-2867149495ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-774030869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c951c4-2d6c-4040-92ce-9f4f33fdcec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b55146d09814d23b42b3cd2e9278f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dea142b1-272f-4947-8336-46283e329c7e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:24Z,use_quota=True,user_id='5375605038184155b97da368a7b0e5ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829699ec-5762-4c1d-b868-b4715e8b9b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829699ec-5762-4c1d-b868-b4715e8b9b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bae8dcd-270a-4fa4-a571-528e0e61460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bae8dcd-270a-4fa4-a571-528e0e61460f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52c951c4-2d6c-4040-92ce-9f4f33fdcec0', 'volume_name': 'volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0', 'volume_size': 1, 'snapshot_id': 'dea142b1-272f-4947-8336-46283e329c7e'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e254072-30ea-4176-a564-d6119e5d8440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e254072-30ea-4176-a564-d6119e5d8440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3c7500-e52e-497f-b37a-fc8a10834095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:23 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Volume 52c951c4-2d6c-4040-92ce-9f4f33fdcec0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0', 'volume_size': 1, 'snapshot_id': 'dea142b1-272f-4947-8336-46283e329c7e'}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-dea142b1-272f-4947-8336-46283e329c7e-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dea142b1-272f-4947-8336-46283e329c7e-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Creating volume 52c951c4-2d6c-4040-92ce-9f4f33fdcec0 from snapshot dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:23 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.264s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Deleted volume successfully.
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] snapshot: dea142b1-272f-4947-8336-46283e329c7e, volume: 52c951c4-2d6c-4040-92ce-9f4f33fdcec0,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:23 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3ed00ddb-75d7-44cd-8bf7-b802f4d06283 tempest-VolumesSnapshotListTestJSON-1118169108 None] Lock "cinder-56c19f47-846a-4f1a-8286-5a8c0577baf9-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b" returned: 0 in 0.611s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9547b838-8b2c-4f11-a482-bc40af1a1876]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:23 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff
Sep 08 16:41:23 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:24 devstack sudo[99447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e
Sep 08 16:41:24 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:24 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff" returned: 0 in 0.378s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:24 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff
Sep 08 16:41:24 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:24 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e" returned: 0 in 0.417s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dba2e225-e302-4c9a-b929-89febb59bcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8681ae1-21b7-4c9a-ad72-4797834eb56c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:24 devstack sudo[99459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd
Sep 08 16:41:24 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:24 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b.e12ab8c6-7e37-4180-b186-4ce153f653ff" returned: 0 in 0.288s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e12ab8c6-7e37-4180-b186-4ce153f653ff" released by "_delete_snapshot" :: held 1.795s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-5c214397-6a8d-46c6-b693-6afa7006446b" released by "delete_snapshot" :: held 1.824s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:24 devstack cinder-volume[87505]: WARNING cinder.quota [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-245147402 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-245147402, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] Created reservations ['cb2abfa4-b4b3-4012-8101-d1a15d5356da', '050b2459-e8ba-419d-a77a-084d3cbc8fa0', '9d5d2851-0537-4721-b9ea-fe131b6ab449', 'e082f900-cd1b-4da1-9c44-d774335bb3f8'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:24 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd" returned: 0 in 0.410s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:41:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:24 devstack sudo[99465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0
Sep 08 16:41:24 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f14820a4-6f46-4501-a1d7-66794200521c tempest-GroupSnapshotsTest-783420116 None] group_snapshot 7933ec94-0111-4109-8c20-b9c3331fa51b: deleted successfully
Sep 08 16:41:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-5c214397-6a8d-46c6-b693-6afa7006446b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-5c214397-6a8d-46c6-b693-6afa7006446b" acquired by "delete_volume" :: waited 0.041s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:25 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cfbf83-00d8-418b-8b2e-c9bff758bb57]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:25 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b
Sep 08 16:41:25 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:26 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b" returned: 0 in 0.793s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:26 devstack sudo[99483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b
Sep 08 16:41:26 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:26 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5c214397-6a8d-46c6-b693-6afa7006446b" returned: 0 in 0.486s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-5c214397-6a8d-46c6-b693-6afa7006446b" released by "delete_volume" :: held 1.462s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['9478e280-223a-4a33-89da-346415a976ae'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:27 devstack cinder-volume[87505]: WARNING cinder.db.api [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-245147402']
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['5a3c75b1-cd8e-40bb-8e42-1eaca15c06a6', 'f1318d02-c1c4-409b-accc-fa6789107a72', 'e4c2ac48-70d7-493d-b01b-1d0036116882', 'ee4bf70f-184e-413f-a33e-212198f53f7d'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:27 devstack sudo[99486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:27 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:27 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.378s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:27 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8ae7dceb-e3bb-468b-90fc-1c0ada63dad5 tempest-GroupSnapshotsTest-783420116 None] Delete group completed successfully.
Sep 08 16:41:28 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5c80ee76-add4-49f8-849c-9483a36148dd tempest-GroupSnapshotsTest-783420116 None] Group tempest-GroupSnapshotsTest-Group-654583267: creating
Sep 08 16:41:28 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5c80ee76-add4-49f8-849c-9483a36148dd tempest-GroupSnapshotsTest-783420116 None] Group tempest-GroupSnapshotsTest-Group-654583267: created successfully
Sep 08 16:41:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5c80ee76-add4-49f8-849c-9483a36148dd tempest-GroupSnapshotsTest-783420116 None] Create group completed successfully.
Sep 08 16:41:30 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" returned: 0 in 5.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:41:30 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Converted 1024.00 MB image at 195.21 MB/s
Sep 08 16:41:30 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 is being set with open permissions: ugo+rw
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:30 devstack sudo[99490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0
Sep 08 16:41:30 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:30 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" returned: 0 in 0.418s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" released by "_copy_volume_from_snapshot" :: held 6.603s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dea142b1-272f-4947-8336-46283e329c7e-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" released by "_create_volume_from_snapshot" :: held 6.702s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.719s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3c7500-e52e-497f-b37a-fc8a10834095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0', 'volume_size': 1, 'snapshot_id': 'dea142b1-272f-4947-8336-46283e329c7e'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66f9cdb-7729-4b0f-ab94-8b33b32e5b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:30 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Volume volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 (52c951c4-2d6c-4040-92ce-9f4f33fdcec0): created successfully
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66f9cdb-7729-4b0f-ab94-8b33b32e5b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Flow 'volume_create_manager' (ebc8a6e8-4fda-48a5-bfbe-a34e3d569a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d0845e94-7e47-4a1c-b4eb-6c508cdb0ecf tempest-VolumesSnapshotTestJSON-1721620290 None] Created volume successfully.
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Flow 'volume_create_manager' (4627e4e7-f062-45d1-9232-a8f833f65383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb95897-bbad-41d9-aa0b-1792e5f67a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb95897-bbad-41d9-aa0b-1792e5f67a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2121510284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e2ba6-841e-4033-a36d-8b472fafda24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26d94c4037448749b31c7e94244f32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:31Z,use_quota=True,user_id='a1e048c5cf3c4c9f87df4b3aca352e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa01a0d-5922-4b9b-8c05-9a666ce258d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa01a0d-5922-4b9b-8c05-9a666ce258d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ad4399-ab62-44fd-93ba-62fde11d3a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ad4399-ab62-44fd-93ba-62fde11d3a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83e2ba6-841e-4033-a36d-8b472fafda24', 'volume_name': 'volume-e83e2ba6-841e-4033-a36d-8b472fafda24', 'volume_size': 2}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aee8ea-7f30-4d16-920d-69bfeb4e9ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1aee8ea-7f30-4d16-920d-69bfeb4e9ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572972dd-243e-4cb0-ae09-478f0ab63664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:30 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Volume e83e2ba6-841e-4033-a36d-8b472fafda24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83e2ba6-841e-4033-a36d-8b472fafda24', 'volume_size': 2}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2121510284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83e2ba6-841e-4033-a36d-8b472fafda24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26d94c4037448749b31c7e94244f32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:31Z,use_quota=True,user_id='a1e048c5cf3c4c9f87df4b3aca352e34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Creating volume e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:30 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 2147483648 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:30 devstack sudo[99493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 2147483648
Sep 08 16:41:30 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (0466187e-f4b4-41fd-968f-a89aa568e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7199c5-bfc5-4ae7-97e8-83bce75a3d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7199c5-bfc5-4ae7-97e8-83bce75a3d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1632408492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6bb8474e-9cf5-486b-934c-df41407a12bd,host='devstack@QuobyteHD#QuobyteHD',id=e7dc8fbd-c145-4e74-ac70-ab123defd64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:31Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b434cffa-569d-47b7-8220-01aca5267d84),volume_type_id=b434cffa-569d-47b7-8220-01aca5267d84)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf9eb4-cb41-41d5-817a-c8bd87a280c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf9eb4-cb41-41d5-817a-c8bd87a280c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bc81eb-b01c-454a-8242-2b63500beee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bc81eb-b01c-454a-8242-2b63500beee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7dc8fbd-c145-4e74-ac70-ab123defd64b', 'volume_name': 'volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb174673-1ead-40ce-91ef-64f9a3e6e873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb174673-1ead-40ce-91ef-64f9a3e6e873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b692464-8e87-424b-9d14-ac27677235c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:31 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Volume e7dc8fbd-c145-4e74-ac70-ab123defd64b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b', 'volume_size': 1}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:31 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 2147483648" returned: 0 in 0.464s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:31 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24
Sep 08 16:41:31 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:31 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24" returned: 0 in 0.253s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6bb8474e-9cf5-486b-934c-df41407a12bd,created_at=2026-09-08T14:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1632408492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6bb8474e-9cf5-486b-934c-df41407a12bd,host='devstack@QuobyteHD#QuobyteHD',id=e7dc8fbd-c145-4e74-ac70-ab123defd64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:31Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b434cffa-569d-47b7-8220-01aca5267d84),volume_type_id=b434cffa-569d-47b7-8220-01aca5267d84)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Creating volume e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:31 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:31 devstack sudo[99504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b 1073741824
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572972dd-243e-4cb0-ae09-478f0ab63664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83e2ba6-841e-4033-a36d-8b472fafda24', 'volume_size': 2}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:31 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1961bed0-9034-4cd7-87f8-f8fda3eb4e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:31 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Volume volume-e83e2ba6-841e-4033-a36d-8b472fafda24 (e83e2ba6-841e-4033-a36d-8b472fafda24): created successfully
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1961bed0-9034-4cd7-87f8-f8fda3eb4e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Flow 'volume_create_manager' (4627e4e7-f062-45d1-9232-a8f833f65383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-37f1adac-8280-476c-a6e5-a868d8b32205 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Created volume successfully.
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-52c951c4-2d6c-4040-92ce-9f4f33fdcec0-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-52c951c4-2d6c-4040-92ce-9f4f33fdcec0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31bc49f-f2e7-46f5-b880-09a46944d512]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:31 devstack sudo[99506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0
Sep 08 16:41:31 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:32 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b 1073741824" returned: 0 in 0.491s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:32 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b
Sep 08 16:41:32 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:32 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" returned: 0 in 0.385s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:32 devstack sudo[99517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0
Sep 08 16:41:32 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:32 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b692464-8e87-424b-9d14-ac27677235c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51b213-5b5f-4ff7-a362-e2062233006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:32 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Volume volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b (e7dc8fbd-c145-4e74-ac70-ab123defd64b): created successfully
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51b213-5b5f-4ff7-a362-e2062233006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:32 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (0466187e-f4b4-41fd-968f-a89aa568e888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-52c951c4-2d6c-4040-92ce-9f4f33fdcec0" released by "delete_volume" :: held 0.687s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:32 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-88d0e6ba-c291-4cf4-8325-6dbba5ad138e tempest-GroupSnapshotsTest-783420116 None] Created volume successfully.
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['e4d0c81e-f823-4105-af5f-2a44181d4bf0', 'fa63171b-6fb6-4ed6-a2b0-17f681e3235d', '4a9dfff5-bcc0-411e-ab33-b112a02696d6', 'f728b17a-6d68-4931-8305-bff2cde106ee'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:32 devstack sudo[99521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:32 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:32 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:32 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Deleted volume successfully.
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c1068ca4-a896-4304-8578-ff74a8f6502b tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-52c951c4-2d6c-4040-92ce-9f4f33fdcec0-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-dea142b1-272f-4947-8336-46283e329c7e-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-dea142b1-272f-4947-8336-46283e329c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-dba2e225-e302-4c9a-b929-89febb59bcbd" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dba2e225-e302-4c9a-b929-89febb59bcbd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-dea142b1-272f-4947-8336-46283e329c7e" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dea142b1-272f-4947-8336-46283e329c7e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Deleting offline snapshot dea142b1-272f-4947-8336-46283e329c7e of volume dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] snapshot_file for this snap is: volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c48e2e-3bb5-4a5a-bc37-4fd99ce00034]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Creating offline snapshot 78afedfd-1472-4700-abaf-cd738601c0dd of volume e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f7ad3d-5f43-4156-b228-1013ef808762]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:33 devstack sudo[99526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e
Sep 08 16:41:33 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:33 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24
Sep 08 16:41:33 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:33 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e" returned: 0 in 0.412s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dba2e225-e302-4c9a-b929-89febb59bcbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:33 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24" returned: 0 in 0.376s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd 2G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda70c7f-8853-47fc-8edb-e9bdb0fb5068]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:33 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd 2G
Sep 08 16:41:33 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:33 devstack sudo[99538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd
Sep 08 16:41:33 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (bdf66352-165f-4d3b-8eb6-9e48c53b05a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b94e1b-b752-420f-b375-2c937d2569f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b94e1b-b752-420f-b375-2c937d2569f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223367952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6bb8474e-9cf5-486b-934c-df41407a12bd,host='devstack@QuobyteHD#QuobyteHD',id=2087fdf9-f87e-42d1-9e15-9f5bcd4de62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:34Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b434cffa-569d-47b7-8220-01aca5267d84),volume_type_id=b434cffa-569d-47b7-8220-01aca5267d84)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a63ae1-38c0-43bf-85c6-35f88a33bd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a63ae1-38c0-43bf-85c6-35f88a33bd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d06ad-6365-455c-a733-d54a664f6742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d06ad-6365-455c-a733-d54a664f6742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2087fdf9-f87e-42d1-9e15-9f5bcd4de62e', 'volume_name': 'volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a276931-9fb6-4bb0-a82c-a8fbde846839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a276931-9fb6-4bb0-a82c-a8fbde846839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10909d58-d6c8-4799-a9d4-84a28c90aa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:33 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Volume 2087fdf9-f87e-42d1-9e15-9f5bcd4de62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e', 'volume_size': 1}
Sep 08 16:41:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:34 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd 2G" returned: 0 in 0.587s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83e2ba6-841e-4033-a36d-8b472fafda24 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:34 devstack sudo[99546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83e2ba6-841e-4033-a36d-8b472fafda24 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd
Sep 08 16:41:34 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:34 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd" returned: 0 in 0.630s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:34 devstack sudo[99549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e
Sep 08 16:41:34 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:34 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e83e2ba6-841e-4033-a36d-8b472fafda24 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:34 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd is being set with open permissions: ugo+rw
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:34 devstack sudo[99559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd
Sep 08 16:41:34 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:34 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e" returned: 0 in 0.380s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:34 devstack sudo[99561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e
Sep 08 16:41:34 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Flow 'volume_create_manager' (86833457-ca7b-48df-aa01-a58daede5f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095d4019-485f-438b-b8c0-c69425f0a245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095d4019-485f-438b-b8c0-c69425f0a245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1162360384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b79148-a80d-42e4-a934-dd33d84ddef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a822f92d984cacaa4fa5babc9de94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:35Z,use_quota=True,user_id='2c19e94a2f354b93ba12faf4cd045878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485887f5-cbc7-4c62-80b6-9172c056c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485887f5-cbc7-4c62-80b6-9172c056c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35b6f7e-5f40-4411-82cf-44c9904674e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f35b6f7e-5f40-4411-82cf-44c9904674e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b79148-a80d-42e4-a934-dd33d84ddef0', 'volume_name': 'volume-50b79148-a80d-42e4-a934-dd33d84ddef0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42eb969e-b685-4e39-b76f-8358bcf83d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42eb969e-b685-4e39-b76f-8358bcf83d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5442d-9195-4763-ae52-55169450a6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Volume 50b79148-a80d-42e4-a934-dd33d84ddef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b79148-a80d-42e4-a934-dd33d84ddef0', 'volume_size': 1}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:34 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:34 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.info
Sep 08 16:41:34 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:34 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd.dea142b1-272f-4947-8336-46283e329c7e" returned: 0 in 0.263s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dea142b1-272f-4947-8336-46283e329c7e" released by "_delete_snapshot" :: held 1.800s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dba2e225-e302-4c9a-b929-89febb59bcbd" released by "delete_snapshot" :: held 1.825s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:34 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['2ebf66ec-9cac-45b9-b7bc-9319c610c658', '93103de4-78b7-4efd-8194-6ed89a542b16', 'bfb99819-27ff-476d-a9ad-b90e857ad878', 'efd7e204-7661-4cb3-8308-00f9106e15da'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Delete snapshot completed successfully.
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.info" returned: 0 in 0.251s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:35 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.info is being set with open permissions: ugo+rw
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4f792aad-06b6-4b58-a908-ff68c9021ab2 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-dea142b1-272f-4947-8336-46283e329c7e-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:34 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:34 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.info
Sep 08 16:41:34 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:35 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-dba2e225-e302-4c9a-b929-89febb59bcbd-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.info" returned: 0 in 0.271s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.184s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.252s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6bb8474e-9cf5-486b-934c-df41407a12bd,created_at=2026-09-08T14:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223367952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6bb8474e-9cf5-486b-934c-df41407a12bd,host='devstack@QuobyteHD#QuobyteHD',id=2087fdf9-f87e-42d1-9e15-9f5bcd4de62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:34Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b434cffa-569d-47b7-8220-01aca5267d84),volume_type_id=b434cffa-569d-47b7-8220-01aca5267d84)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Creating volume 2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:35 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-dba2e225-e302-4c9a-b929-89febb59bcbd-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:35 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e 1073741824
Sep 08 16:41:35 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2213a216-c039-4841-8925-f9f5a670d579 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Create snapshot completed successfully
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-dba2e225-e302-4c9a-b929-89febb59bcbd" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dba2e225-e302-4c9a-b929-89febb59bcbd" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d743b5a-6423-479b-94c0-cabb40f652f6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:35 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd
Sep 08 16:41:35 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:35 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e 1073741824" returned: 0 in 0.411s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:35 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd" returned: 0 in 0.356s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:35 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e
Sep 08 16:41:35 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:35 devstack sudo[99585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd
Sep 08 16:41:35 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:35 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" returned: 0 in 0.227s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1162360384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b79148-a80d-42e4-a934-dd33d84ddef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23a822f92d984cacaa4fa5babc9de94d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:35Z,use_quota=True,user_id='2c19e94a2f354b93ba12faf4cd045878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Creating volume 50b79148-a80d-42e4-a934-dd33d84ddef0 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:35 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:35 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dba2e225-e302-4c9a-b929-89febb59bcbd" returned: 0 in 0.244s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:35 devstack sudo[99589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0 1073741824
Sep 08 16:41:35 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10909d58-d6c8-4799-a9d4-84a28c90aa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19c8f67-0199-418e-8f04-d07a7965b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-dba2e225-e302-4c9a-b929-89febb59bcbd" released by "delete_volume" :: held 0.664s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Volume volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e (2087fdf9-f87e-42d1-9e15-9f5bcd4de62e): created successfully
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19c8f67-0199-418e-8f04-d07a7965b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (bdf66352-165f-4d3b-8eb6-9e48c53b05a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f4677faa-f2e9-44c4-95a3-2143c61762a1 tempest-GroupSnapshotsTest-783420116 None] Created volume successfully.
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['e754bf97-382c-472f-b287-8dc322d41271', '5cf3689a-f2dd-4bf2-a60f-6564fd2b2e01', '36f8cbcf-0b22-4fb9-a597-a70c4381fed4', '2d989b83-c770-4d26-93dd-fb1c1b1896a3'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:36 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:36 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "cinder-78afedfd-1472-4700-abaf-cd738601c0dd-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:36 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.296s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Deleted volume successfully.
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-78afedfd-1472-4700-abaf-cd738601c0dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "cinder-quobyte-e83e2ba6-841e-4033-a36d-8b472fafda24" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:36 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-quobyte-e83e2ba6-841e-4033-a36d-8b472fafda24" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "cinder-quobyte-78afedfd-1472-4700-abaf-cd738601c0dd" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0 1073741824" returned: 0 in 0.527s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a909fd1-c5a3-4b68-aa5e-ebd8dc322d59 tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-dba2e225-e302-4c9a-b929-89febb59bcbd-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-quobyte-78afedfd-1472-4700-abaf-cd738601c0dd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Deleting offline snapshot 78afedfd-1472-4700-abaf-cd738601c0dd of volume e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] snapshot_file for this snap is: volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[851be91f-d460-407e-9427-f374b0271574]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:36 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0
Sep 08 16:41:36 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:36 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd
Sep 08 16:41:36 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1769aa05-c66e-42eb-b42a-23352485f092 tempest-GroupSnapshotsTest-783420116 None] Update group completed successfully.
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "cinder-quobyte-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a5feb4-341e-4984-aba8-0ae63150d0f9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:36 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e
Sep 08 16:41:36 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:36 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5442d-9195-4763-ae52-55169450a6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b79148-a80d-42e4-a934-dd33d84ddef0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7570e0-e68f-4feb-bb38-c86238724472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:36 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Volume volume-50b79148-a80d-42e4-a934-dd33d84ddef0 (50b79148-a80d-42e4-a934-dd33d84ddef0): created successfully
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7570e0-e68f-4feb-bb38-c86238724472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Flow 'volume_create_manager' (86833457-ca7b-48df-aa01-a58daede5f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:36 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2791e8e8-c817-4b49-9ab7-d7fef5f23ba6 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Created volume successfully.
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd" returned: 0 in 0.425s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e83e2ba6-841e-4033-a36d-8b472fafda24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10d830-ea5a-4a70-8829-b687ef409a58]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:37 devstack sudo[99609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24
Sep 08 16:41:37 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:37 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" returned: 0 in 0.372s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:37 devstack sudo[99615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e
Sep 08 16:41:37 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:37 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24" returned: 0 in 0.360s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:37 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd
Sep 08 16:41:37 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:37 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-quobyte-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e" released by "delete_volume" :: held 0.687s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Created reservations ['89e9c923-7828-4cab-a547-5b46161f7396', 'ec873977-c7dd-4d41-9e33-111aaf9b01bc', '4b311d75-caee-467d-b6c8-ff7393ad8d3a', '0f23e8d7-7398-4f05-91ab-d1deda1c071a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:37 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:37 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:37 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd" returned: 0 in 0.377s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:37 devstack sudo[99629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd
Sep 08 16:41:37 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:37 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Deleted volume successfully.
Sep 08 16:41:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0541c0d2-69da-4a16-886e-8c6a78e15c9e tempest-VolumesSnapshotTestJSON-1721620290 None] Lock "cinder-1cd4fcb7-e59c-400c-9ee6-ea8793e1266e-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-eaa5415b-dd58-42fe-8e39-6ef524a23e79 tempest-GroupSnapshotsTest-783420116 None] Update group completed successfully.
Sep 08 16:41:38 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24.78afedfd-1472-4700-abaf-cd738601c0dd" returned: 0 in 0.357s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-quobyte-78afedfd-1472-4700-abaf-cd738601c0dd" released by "_delete_snapshot" :: held 1.649s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-quobyte-e83e2ba6-841e-4033-a36d-8b472fafda24" released by "delete_snapshot" :: held 1.691s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Created reservations ['9bd37b83-e392-42cc-aeb0-c5dd13b15e64', '02ab0e09-fc63-4a13-a3df-de1ca661f592', '0273ebac-0109-4c37-b8c5-5c8410e68cc2', 'c636cf31-7769-4be1-bdf4-ff18fb71402d'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Delete snapshot completed successfully.
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cc7987b5-4233-4dcf-80f3-9d598ad2030b tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-78afedfd-1472-4700-abaf-cd738601c0dd-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "cinder-e83e2ba6-841e-4033-a36d-8b472fafda24-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-e83e2ba6-841e-4033-a36d-8b472fafda24-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-a8077a86-cf0b-4abc-877f-b208d6b0cf24 req-727ce895-635e-402a-9e58-ca9c27d4d543 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-a8077a86-cf0b-4abc-877f-b208d6b0cf24 req-727ce895-635e-402a-9e58-ca9c27d4d543 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-a8077a86-cf0b-4abc-877f-b208d6b0cf24 req-727ce895-635e-402a-9e58-ca9c27d4d543 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "cinder-quobyte-e83e2ba6-841e-4033-a36d-8b472fafda24" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-quobyte-e83e2ba6-841e-4033-a36d-8b472fafda24" acquired by "delete_volume" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-a8077a86-cf0b-4abc-877f-b208d6b0cf24 req-727ce895-635e-402a-9e58-ca9c27d4d543 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-50b79148-a80d-42e4-a934-dd33d84ddef0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0078842-d406-4b8d-9096-81df3e9c4793', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de689ff-642c-4800-8bdf-d8e209db8aef]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-a8077a86-cf0b-4abc-877f-b208d6b0cf24 req-727ce895-635e-402a-9e58-ca9c27d4d543 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] attachment_update completed successfully.
Sep 08 16:41:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6148cfb1-0e55-460b-a224-b673ea761729 tempest-GroupSnapshotsTest-783420116 None] Update group completed successfully.
Sep 08 16:41:39 devstack sudo[99650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24
Sep 08 16:41:39 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:39 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24" returned: 0 in 0.530s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:39 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24
Sep 08 16:41:39 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:39 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e83e2ba6-841e-4033-a36d-8b472fafda24" returned: 0 in 0.299s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-quobyte-e83e2ba6-841e-4033-a36d-8b472fafda24" released by "delete_volume" :: held 0.947s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Created reservations ['e3787693-98cf-4382-b45e-d93499e08b9a', 'da18b0ad-81a5-46a0-b3fd-5f25cb0fe806', 'a2fdbbd7-2943-419d-b653-2f86882180d8', 'aa61cda7-732d-49b3-b11e-116b7d1a7ab1'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:39 devstack sudo[100044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:39 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:40 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.284s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:40 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Deleted volume successfully.
Sep 08 16:41:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6a13c3e3-3e1a-461d-9e43-e517427b48fe tempest-GroupSnapshotsTest-783420116 None] Update group completed successfully.
Sep 08 16:41:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18d6b44b-ced9-44d9-baa6-fe390118fa19 tempest-VolumesSnapshotNegativeTestJSON-1406022324 None] Lock "cinder-e83e2ba6-841e-4033-a36d-8b472fafda24-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] GroupSnapshot 11784137-c96c-4d1d-b704-18fd2e4943a1: creating.
Sep 08 16:41:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Group snapshot 11784137-c96c-4d1d-b704-18fd2e4943a1: creating. {{(pid=87505) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 08 16:41:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Creating offline snapshot 9910dffc-d353-4c61-ba10-30b016fe3720 of volume e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a6fc3-95cd-42b2-b132-f0b9eb2bd550]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:42 devstack sudo[100048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b
Sep 08 16:41:42 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:42 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-8db62bf6-e3d5-4793-a179-4e454c8458e7 req-d1449a15-3ad8-47c8-9675-07da6a90f6da tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Terminate volume connection completed successfully.
Sep 08 16:41:42 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-8db62bf6-e3d5-4793-a179-4e454c8458e7 req-d1449a15-3ad8-47c8-9675-07da6a90f6da tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Deleting attachment f0078842-d406-4b8d-9096-81df3e9c4793. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:41:42 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b" returned: 0 in 0.461s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:42 devstack sudo[100079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 1G
Sep 08 16:41:42 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:42 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 1G" returned: 0 in 0.568s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:42 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720
Sep 08 16:41:42 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:43 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720" returned: 0 in 0.376s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:43 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:43 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720
Sep 08 16:41:43 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Acquiring lock "cinder-50b79148-a80d-42e4-a934-dd33d84ddef0-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "cinder-50b79148-a80d-42e4-a934-dd33d84ddef0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Acquiring lock "cinder-quobyte-50b79148-a80d-42e4-a934-dd33d84ddef0" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "cinder-quobyte-50b79148-a80d-42e4-a934-dd33d84ddef0" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c8bbb-c454-4d30-a972-af5efef31e6b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:43 devstack sudo[100094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0
Sep 08 16:41:43 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:43 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720" returned: 0 in 0.510s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:43 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.info
Sep 08 16:41:43 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:44 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0" returned: 0 in 0.420s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:44 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0
Sep 08 16:41:44 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:44 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.info" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:44 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:44 devstack sudo[100105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.info
Sep 08 16:41:44 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:44 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-50b79148-a80d-42e4-a934-dd33d84ddef0" returned: 0 in 0.315s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "cinder-quobyte-50b79148-a80d-42e4-a934-dd33d84ddef0" released by "delete_volume" :: held 0.801s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Created reservations ['d3d46a5c-9720-4f35-9fa6-0808dfc25cab', '791cf80e-1e12-48e4-99e8-abc02509185e', '18f2fac9-6db7-4d6d-bbc9-ee4ae6d4c1fa', 'af09decf-71c5-417e-b5fc-a481970a8ad5'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:44 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.info" returned: 0 in 0.303s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Creating offline snapshot d66b2583-c16a-4331-a1dd-f7012e729ff4 of volume 2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d956b07-5665-40be-8080-052c8acc679a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:44 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:44 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:44 devstack sudo[100110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e
Sep 08 16:41:44 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:44 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.359s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:44 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:44 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Deleted volume successfully.
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a8283b91-9810-419e-86ca-0c00cd714985 tempest-TestServerVolumeAttachScenarioOldVersion-578003084 None] Lock "cinder-50b79148-a80d-42e4-a934-dd33d84ddef0-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:45 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" returned: 0 in 0.527s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:45 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 1G
Sep 08 16:41:45 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:45 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 1G" returned: 0 in 0.725s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:45 devstack sudo[100144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4
Sep 08 16:41:45 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (35cdb160-6bed-4c08-9d7c-2ccda91be33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9424ce-7437-468d-9c99-1428eae93f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9424ce-7437-468d-9c99-1428eae93f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982773391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316711a5-9067-4356-b458-d327fc89e946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:46Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73365f86-cba2-4365-856a-0e42d530c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:45 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73365f86-cba2-4365-856a-0e42d530c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e5a7ba-cb92-43e0-8749-7d3b0adb28ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e5a7ba-cb92-43e0-8749-7d3b0adb28ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '316711a5-9067-4356-b458-d327fc89e946', 'volume_name': 'volume-316711a5-9067-4356-b458-d327fc89e946', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24057173-54b4-4031-b328-739deea89fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24057173-54b4-4031-b328-739deea89fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fdfd02-5fb4-4cf9-834a-a55ac2653f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Volume 316711a5-9067-4356-b458-d327fc89e946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-316711a5-9067-4356-b458-d327fc89e946', 'volume_size': 1}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:46 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4" returned: 0 in 0.480s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:46 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:46 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4
Sep 08 16:41:46 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (af1a1035-13de-47d5-80c1-6dae222b071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865fce6c-19d7-457d-b5be-8ce93659eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (865fce6c-19d7-457d-b5be-8ce93659eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049262840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8ee208-2e1f-4e7f-9d71-09617e61fd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:46Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8e68ee-ab4e-421b-9f41-07f1d017fb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8e68ee-ab4e-421b-9f41-07f1d017fb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468e01dd-55f2-438a-9af9-aad068d515fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468e01dd-55f2-438a-9af9-aad068d515fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8ee208-2e1f-4e7f-9d71-09617e61fd14', 'volume_name': 'volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584bf73c-592f-491b-a99e-9536694fe3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584bf73c-592f-491b-a99e-9536694fe3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72edb03-9da3-4cd0-8565-75d9dabc51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:46 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Volume 6e8ee208-2e1f-4e7f-9d71-09617e61fd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14', 'volume_size': 1}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:46 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4" returned: 0 in 0.375s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:46 devstack sudo[100153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.info
Sep 08 16:41:46 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (e364aeb7-b14e-4e7c-a68b-658287c0b809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b819c2ed-b283-40d8-a7e5-2efd2062ca32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b819c2ed-b283-40d8-a7e5-2efd2062ca32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146527244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88c6cc0-3d76-4104-b232-1c2d1133fb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:47Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:47 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df7096-8568-47bc-b7e4-4637d4501722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34df7096-8568-47bc-b7e4-4637d4501722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcefc899-87cc-4430-97a4-c6a3cc9dd467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcefc899-87cc-4430-97a4-c6a3cc9dd467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88c6cc0-3d76-4104-b232-1c2d1133fb77', 'volume_name': 'volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4ae41e-4ceb-488e-aa7c-03a706f54cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4ae41e-4ceb-488e-aa7c-03a706f54cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34a31d5-41f9-426a-977a-0805011b5d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Volume e88c6cc0-3d76-4104-b232-1c2d1133fb77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77', 'volume_size': 1}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.info" returned: 0 in 0.451s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:47 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:47 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.info
Sep 08 16:41:47 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:47 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.info" returned: 0 in 0.353s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.046s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982773391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=316711a5-9067-4356-b458-d327fc89e946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:46Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Creating volume 316711a5-9067-4356-b458-d327fc89e946 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:47 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:47 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946 1073741824
Sep 08 16:41:47 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (e9ccea24-4361-402f-90fb-f1702472f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d26c249-2dd8-4ff8-9cfc-adf1f280227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d26c249-2dd8-4ff8-9cfc-adf1f280227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58496855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:48Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93718b17-0b84-4399-b29f-cde7b4f7412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93718b17-0b84-4399-b29f-cde7b4f7412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8d576e-50ae-4758-8352-6d012b55b20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8d576e-50ae-4758-8352-6d012b55b20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343', 'volume_name': 'volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a87389-7d22-42a1-b0d6-57a06c8487bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6a87389-7d22-42a1-b0d6-57a06c8487bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195567b3-59c1-48f7-a486-eff0083eda0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Volume 4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343', 'volume_size': 1}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4286fc1c-3602-4a75-9858-8dd5a1bb552f tempest-GroupSnapshotsTest-783420116 None] group_snapshot 11784137-c96c-4d1d-b704-18fd2e4943a1: created successfully
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (6f881c85-13c9-4ea0-ad00-3b53f2eb43f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02097bf-39b5-4714-be84-a3aa32a5ea68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02097bf-39b5-4714-be84-a3aa32a5ea68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679300028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058ddb41-260f-4a7a-9daf-456a0082b3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:48Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24514ad-3db2-4656-bbae-6b1318997525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24514ad-3db2-4656-bbae-6b1318997525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c18e80-693e-4f31-ace5-8db9dae3ccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c18e80-693e-4f31-ace5-8db9dae3ccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058ddb41-260f-4a7a-9daf-456a0082b3d6', 'volume_name': 'volume-058ddb41-260f-4a7a-9daf-456a0082b3d6', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf01da2-5439-4c6d-becf-eebffff44fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf01da2-5439-4c6d-becf-eebffff44fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:48 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ff187-a665-4850-9c29-bb530e1bcdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Volume 058ddb41-260f-4a7a-9daf-456a0082b3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058ddb41-260f-4a7a-9daf-456a0082b3d6', 'volume_size': 1}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946 1073741824" returned: 0 in 0.787s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] group_snapshot 11784137-c96c-4d1d-b704-18fd2e4943a1: deleting
Sep 08 16:41:48 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946
Sep 08 16:41:48 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] group_snapshot 11784137-c96c-4d1d-b704-18fd2e4943a1: deleting {{(pid=87505) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-e7dc8fbd-c145-4e74-ac70-ab123defd64b" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e7dc8fbd-c145-4e74-ac70-ab123defd64b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-9910dffc-d353-4c61-ba10-30b016fe3720" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-9910dffc-d353-4c61-ba10-30b016fe3720" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Deleting offline snapshot 9910dffc-d353-4c61-ba10-30b016fe3720 of volume e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] snapshot_file for this snap is: volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50a137f-0b4f-4932-8bc8-c8f85771574a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:48 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720
Sep 08 16:41:48 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:48 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946" returned: 0 in 0.520s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049262840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8ee208-2e1f-4e7f-9d71-09617e61fd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:46Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Creating volume 6e8ee208-2e1f-4e7f-9d71-09617e61fd14 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:48 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fdfd02-5fb4-4cf9-834a-a55ac2653f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-316711a5-9067-4356-b458-d327fc89e946', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:49 devstack sudo[100172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14 1073741824
Sep 08 16:41:49 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92efda16-0f6e-439f-98e6-ff0e618933c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Volume volume-316711a5-9067-4356-b458-d327fc89e946 (316711a5-9067-4356-b458-d327fc89e946): created successfully
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92efda16-0f6e-439f-98e6-ff0e618933c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (35cdb160-6bed-4c08-9d7c-2ccda91be33e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f65e4b06-a44b-470c-90f8-c6b993602a44 tempest-CreateVolumesFromImageTest-2040376671 None] Created volume successfully.
Sep 08 16:41:49 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720" returned: 0 in 0.551s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5c099d-3900-4c08-afec-7016bcf7ce6b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:49 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b
Sep 08 16:41:49 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:49 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14 1073741824" returned: 0 in 0.609s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:49 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b" returned: 0 in 0.454s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:49 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14
Sep 08 16:41:49 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:49 devstack sudo[100187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720
Sep 08 16:41:49 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:49 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14" returned: 0 in 0.330s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.786s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146527244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88c6cc0-3d76-4104-b232-1c2d1133fb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:47Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Creating volume e88c6cc0-3d76-4104-b232-1c2d1133fb77 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:49 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c72edb03-9da3-4cd0-8565-75d9dabc51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb571c7-7f27-429d-b24a-e8cd64c3696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:50 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77 1073741824
Sep 08 16:41:50 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:50 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Volume volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14 (6e8ee208-2e1f-4e7f-9d71-09617e61fd14): created successfully
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb571c7-7f27-429d-b24a-e8cd64c3696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (af1a1035-13de-47d5-80c1-6dae222b071d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:50 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720" returned: 0 in 0.421s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8d9cec18-167f-4eca-aaf0-3764b984b54e tempest-CreateVolumesFromImageTest-2040376671 None] Created volume successfully.
Sep 08 16:41:50 devstack sudo[100196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720
Sep 08 16:41:50 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:50 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b.9910dffc-d353-4c61-ba10-30b016fe3720" returned: 0 in 0.401s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-9910dffc-d353-4c61-ba10-30b016fe3720" released by "_delete_snapshot" :: held 1.957s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e7dc8fbd-c145-4e74-ac70-ab123defd64b" released by "delete_snapshot" :: held 1.985s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-d66b2583-c16a-4331-a1dd-f7012e729ff4" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-d66b2583-c16a-4331-a1dd-f7012e729ff4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Deleting offline snapshot d66b2583-c16a-4331-a1dd-f7012e729ff4 of volume 2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] snapshot_file for this snap is: volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d587e25-7238-4d5d-918b-d7011c2d5c47]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:50 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77 1073741824" returned: 0 in 0.650s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:50 devstack sudo[100205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77
Sep 08 16:41:50 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:50 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4
Sep 08 16:41:50 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:50 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77" returned: 0 in 0.300s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.983s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58496855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:48Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Creating volume 4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:51 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34a31d5-41f9-426a-977a-0805011b5d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:51 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 1073741824
Sep 08 16:41:51 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd47072-fdd3-4a0c-bf8c-f6d0dc811310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:51 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Volume volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77 (e88c6cc0-3d76-4104-b232-1c2d1133fb77): created successfully
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd47072-fdd3-4a0c-bf8c-f6d0dc811310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (e364aeb7-b14e-4e7c-a68b-658287c0b809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0a43af59-b93e-4ef0-b7ed-7705a66301fd tempest-CreateVolumesFromImageTest-2040376671 None] Created volume successfully.
Sep 08 16:41:51 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4" returned: 0 in 0.495s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d54a8-ee13-463d-8da2-d501cd4c80c7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:51 devstack sudo[100214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e
Sep 08 16:41:51 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:51 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 1073741824" returned: 0 in 0.546s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:51 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" returned: 0 in 0.453s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:51 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343
Sep 08 16:41:51 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:51 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4
Sep 08 16:41:51 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:51 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.532s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679300028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058ddb41-260f-4a7a-9daf-456a0082b3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2213c18511144f9a4682dcb4c225d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:48Z,use_quota=True,user_id='69921d68f0994df99e7a343c1edb312f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Creating volume 058ddb41-260f-4a7a-9daf-456a0082b3d6 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:51 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195567b3-59c1-48f7-a486-eff0083eda0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192b39b3-82b7-4f1e-b756-96ca8c308bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:52 devstack sudo[100234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6 1073741824
Sep 08 16:41:52 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Volume volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 (4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343): created successfully
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192b39b3-82b7-4f1e-b756-96ca8c308bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (e9ccea24-4361-402f-90fb-f1702472f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b3d6d6c9-f7cd-4f64-86c4-37004b606e99 tempest-CreateVolumesFromImageTest-2040376671 None] Created volume successfully.
Sep 08 16:41:52 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4" returned: 0 in 0.519s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:52 devstack sudo[100236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4
Sep 08 16:41:52 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:52 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e.d66b2583-c16a-4331-a1dd-f7012e729ff4" returned: 0 in 0.306s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:52 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6 1073741824" returned: 0 in 0.532s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-d66b2583-c16a-4331-a1dd-f7012e729ff4" released by "_delete_snapshot" :: held 1.905s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" released by "delete_snapshot" :: held 1.941s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:52 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6
Sep 08 16:41:52 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:52 devstack cinder-volume[87505]: WARNING cinder.quota [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1211060198 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1211060198, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:41:52 devstack cinder-volume[87505]: WARNING cinder.quota [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1211060198 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1211060198, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['f03bb2d6-bfa6-4dfb-b567-874ac8a00e2e', '0b3f59fc-f9b1-432e-88c0-06817e287291', '821fc0ee-e664-4d8d-a680-645c596f0dd0', 'f3db386f-35d2-49d3-bb23-68e09554c948'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['968fb02c-bb0b-4001-b974-851a9dfba54c', 'c6d91942-a075-429c-9110-433263e12b44', 'fe761b9c-2c70-415a-9199-4914be00b1ba', '0a5e5d5a-d0fb-4a76-8558-de1e8821060c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:52 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ff187-a665-4850-9c29-bb530e1bcdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058ddb41-260f-4a7a-9daf-456a0082b3d6', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fb33bb-e38c-415c-ba8d-3cf9c87ec717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f88cbdb9-27cc-4ff9-bf09-bb12d12439b1 tempest-GroupSnapshotsTest-783420116 None] group_snapshot 11784137-c96c-4d1d-b704-18fd2e4943a1: deleted successfully
Sep 08 16:41:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Volume volume-058ddb41-260f-4a7a-9daf-456a0082b3d6 (058ddb41-260f-4a7a-9daf-456a0082b3d6): created successfully
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fb33bb-e38c-415c-ba8d-3cf9c87ec717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Flow 'volume_create_manager' (6f881c85-13c9-4ea0-ad00-3b53f2eb43f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-bdfaabed-61c7-4c2e-91e9-bb864e4a8247 tempest-CreateVolumesFromImageTest-2040376671 None] Created volume successfully.
Sep 08 16:41:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c85b29-29fa-4054-a9cc-9e0b124d2927]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-058ddb41-260f-4a7a-9daf-456a0082b3d6-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:53 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e
Sep 08 16:41:53 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-058ddb41-260f-4a7a-9daf-456a0082b3d6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-quobyte-058ddb41-260f-4a7a-9daf-456a0082b3d6" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-058ddb41-260f-4a7a-9daf-456a0082b3d6" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4c8739-4257-4e4a-b787-610ef779354a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:54 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6
Sep 08 16:41:54 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:54 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" returned: 0 in 0.555s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:54 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e
Sep 08 16:41:54 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:54 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6" returned: 0 in 0.480s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:54 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6
Sep 08 16:41:54 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:54 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" returned: 0 in 0.326s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-2087fdf9-f87e-42d1-9e15-9f5bcd4de62e" released by "delete_volume" :: held 0.975s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-e7dc8fbd-c145-4e74-ac70-ab123defd64b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e7dc8fbd-c145-4e74-ac70-ab123defd64b" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e29bf6e-8ddb-4011-a3a5-39093a38a4b6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:54 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b
Sep 08 16:41:54 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:54 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-058ddb41-260f-4a7a-9daf-456a0082b3d6" returned: 0 in 0.419s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-058ddb41-260f-4a7a-9daf-456a0082b3d6" released by "delete_volume" :: held 0.970s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Created reservations ['949e2d59-8574-4e80-8fd0-d7f880229bb7', '9781ceff-0304-4934-ab88-77e30200e48a', '00d34a64-1d0a-41df-8b97-a3ed41a214e5', 'e04a56c1-8f74-4516-9f1c-e0289cf04f17'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:55 devstack sudo[100305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:55 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:55 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b" returned: 0 in 0.544s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:55 devstack sudo[100307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b
Sep 08 16:41:55 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:55 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.314s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:55 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Deleted volume successfully.
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6fc65d6d-19bc-46a4-a2ee-432c51e5fc14 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-058ddb41-260f-4a7a-9daf-456a0082b3d6-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:55 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e7dc8fbd-c145-4e74-ac70-ab123defd64b" returned: 0 in 0.309s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-e7dc8fbd-c145-4e74-ac70-ab123defd64b" released by "delete_volume" :: held 0.938s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['12c885f2-6c86-48a6-8568-fbdaf04d7ffd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:55 devstack cinder-volume[87505]: WARNING cinder.quota [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1211060198 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1211060198, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['3fbfbd0e-92a5-47ce-89b4-00e21fbaa18a', '7e93915f-6e84-4c2a-be87-8f53fe180267', '5db7dd2b-4cf0-4278-be9a-496b9e68e1dd', '16dff2cc-a50c-41cb-80b5-e4808a105c8f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:55 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['8f22a717-53ba-4f51-ac39-036508ba9e35', '3c0a32be-4be0-4c39-94af-e9f46a706f9c', 'f263e312-5c31-444f-a93a-1171e640ffae', 'd2d9581b-0014-4679-8d58-cc065a0daec2'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:56 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:56 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:56 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-quobyte-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e6474cf6-8149-4ebe-a1c5-2b053c63b2a9 tempest-GroupSnapshotsTest-783420116 None] Delete group completed successfully.
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343" acquired by "delete_volume" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c711e50-6082-48d7-b61f-bca6cd67c3b7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:56 devstack sudo[100316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:56 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:56 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343
Sep 08 16:41:56 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:56 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.340s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:41:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:41:56 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343" returned: 0 in 0.472s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:57 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343
Sep 08 16:41:57 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ddd26008-214c-4faf-9fcc-7c1b2d0306ac tempest-GroupSnapshotsTest-783420116 None] Group tempest-GroupSnapshotsTest-Group-1706857767: creating
Sep 08 16:41:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ddd26008-214c-4faf-9fcc-7c1b2d0306ac tempest-GroupSnapshotsTest-783420116 None] Group tempest-GroupSnapshotsTest-Group-1706857767: created successfully
Sep 08 16:41:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ddd26008-214c-4faf-9fcc-7c1b2d0306ac tempest-GroupSnapshotsTest-783420116 None] Create group completed successfully.
Sep 08 16:41:57 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343" returned: 0 in 0.313s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343" released by "delete_volume" :: held 0.863s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Created reservations ['99f9ee5e-6ef8-42ba-b9d6-f344cd19882f', 'b83568ae-7d8a-4973-a7d8-668814e5cbcb', '3a429de5-0f16-4f04-bf08-8c4195f6836b', '97a2dacf-0399-4b0f-8d54-fe35b4b9c3e5'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:57 devstack sudo[100326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:57 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-e88c6cc0-3d76-4104-b232-1c2d1133fb77-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-e88c6cc0-3d76-4104-b232-1c2d1133fb77-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-quobyte-e88c6cc0-3d76-4104-b232-1c2d1133fb77" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-e88c6cc0-3d76-4104-b232-1c2d1133fb77" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00dc604-55f7-4cb8-a0e4-565a9e9d2ce5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:57 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.325s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Deleted volume successfully.
Sep 08 16:41:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-08df590d-7ece-4b8e-8229-3569aee93189 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-4b4eb5ce-16f4-4e90-8c2d-7c3a9ffc1343-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:57 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77
Sep 08 16:41:57 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:58 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77" returned: 0 in 0.493s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:58 devstack sudo[100335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77
Sep 08 16:41:58 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:58 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e88c6cc0-3d76-4104-b232-1c2d1133fb77" returned: 0 in 0.305s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-e88c6cc0-3d76-4104-b232-1c2d1133fb77" released by "delete_volume" :: held 0.854s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Created reservations ['11bd527e-451c-4166-b33c-6c5b78d53535', 'fb547185-1451-4de8-a16c-6c9b2463fd43', '26863b81-23ce-4d1d-9de3-5015dda0c380', 'e86ba6fb-d7eb-42d6-bfc2-2fb187202357'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:58 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:41:58 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-6e8ee208-2e1f-4e7f-9d71-09617e61fd14-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-6e8ee208-2e1f-4e7f-9d71-09617e61fd14-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-quobyte-6e8ee208-2e1f-4e7f-9d71-09617e61fd14" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-6e8ee208-2e1f-4e7f-9d71-09617e61fd14" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (aa6f27b5-d592-481c-9ea3-ca73fa2bd4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2af03bc-3ca3-4ffc-9408-4b5132810577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[296996f0-f6ba-4e78-8a4a-3bd9d160efe9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2af03bc-3ca3-4ffc-9408-4b5132810577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830872343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6136ae8d-7e82-4a56-aa62-4a1dd4b86fe7,host='devstack@QuobyteHD#QuobyteHD',id=1c154278-fa2a-410a-9836-11275e4a9221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:59Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(479a8302-be49-4e5f-8406-91bfcf456e12),volume_type_id=479a8302-be49-4e5f-8406-91bfcf456e12)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cdbd94-bda6-442c-b1c4-66784f3174a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25cdbd94-bda6-442c-b1c4-66784f3174a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af36652-936b-4199-bfc5-981813ec2944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af36652-936b-4199-bfc5-981813ec2944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c154278-fa2a-410a-9836-11275e4a9221', 'volume_name': 'volume-1c154278-fa2a-410a-9836-11275e4a9221', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b091275-c8be-4660-9b35-1231a8ff2add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b091275-c8be-4660-9b35-1231a8ff2add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0ac8c8-24a5-4506-baff-3367e032198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:41:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Volume 1c154278-fa2a-410a-9836-11275e4a9221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c154278-fa2a-410a-9836-11275e4a9221', 'volume_size': 1}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6136ae8d-7e82-4a56-aa62-4a1dd4b86fe7,created_at=2026-09-08T14:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830872343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6136ae8d-7e82-4a56-aa62-4a1dd4b86fe7,host='devstack@QuobyteHD#QuobyteHD',id=1c154278-fa2a-410a-9836-11275e4a9221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3b9a283c818422fb7ff29602dca32cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:41:59Z,use_quota=True,user_id='d48d176644f74fa4a4148586e1fb9709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(479a8302-be49-4e5f-8406-91bfcf456e12),volume_type_id=479a8302-be49-4e5f-8406-91bfcf456e12)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Creating volume 1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:41:59 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:59 devstack sudo[100342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 1073741824
Sep 08 16:41:59 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:59 devstack sudo[100340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14
Sep 08 16:41:59 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:59 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.483s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:41:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Deleted volume successfully.
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-3145bee0-ddd6-4ca5-94b4-c6ccc0b1abbf tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-e88c6cc0-3d76-4104-b232-1c2d1133fb77-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:59 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14" returned: 0 in 0.509s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:41:59 devstack sudo[100352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14
Sep 08 16:41:59 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:41:59 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:59 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 1073741824" returned: 0 in 0.676s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6e8ee208-2e1f-4e7f-9d71-09617e61fd14" returned: 0 in 0.270s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-6e8ee208-2e1f-4e7f-9d71-09617e61fd14" released by "delete_volume" :: held 0.872s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:41:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:00 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221
Sep 08 16:42:00 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Created reservations ['eb0a5443-5f3d-43cb-a981-fb37bbf92dad', '7f9da475-b6a4-462b-8fea-2642777b062a', '4e458d1a-81a0-4716-85ec-1c2583c0ae15', 'e659cc2f-2a16-4536-bdfa-07c1f8760d1e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:00 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:00 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-316711a5-9067-4356-b458-d327fc89e946-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-316711a5-9067-4356-b458-d327fc89e946-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:00 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221" returned: 0 in 0.317s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0ac8c8-24a5-4506-baff-3367e032198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c154278-fa2a-410a-9836-11275e4a9221', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2f51d9-e440-4317-8b7e-fc44e5127209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "cinder-quobyte-316711a5-9067-4356-b458-d327fc89e946" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:00 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Volume volume-1c154278-fa2a-410a-9836-11275e4a9221 (1c154278-fa2a-410a-9836-11275e4a9221): created successfully
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2f51d9-e440-4317-8b7e-fc44e5127209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Flow 'volume_create_manager' (aa6f27b5-d592-481c-9ea3-ca73fa2bd4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-316711a5-9067-4356-b458-d327fc89e946" acquired by "delete_volume" :: waited 0.052s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3a66a539-dc8d-4d1a-9179-1f8162f00088 tempest-GroupSnapshotsTest-783420116 None] Created volume successfully.
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc30f9b-1cc2-4d75-abef-299a904f3d9a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:00 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.398s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Deleted volume successfully.
Sep 08 16:42:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-cf144bb6-223b-4f45-aab9-15ae69989c71 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-6e8ee208-2e1f-4e7f-9d71-09617e61fd14-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:00 devstack sudo[100362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946
Sep 08 16:42:00 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:01 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946" returned: 0 in 0.561s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:01 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946
Sep 08 16:42:01 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:01 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-316711a5-9067-4356-b458-d327fc89e946" returned: 0 in 0.293s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-quobyte-316711a5-9067-4356-b458-d327fc89e946" released by "delete_volume" :: held 0.937s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Created reservations ['b3e45f92-6ceb-41fb-8290-fd594f4f0656', '3b64b753-2422-4936-8153-10f801319530', '2a3e6cb7-6918-4055-ad5f-6cecb5245661', '3dc028b4-f9cb-45a1-8922-5b35cdf158b6'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:01 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:01 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:01 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.299s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Deleted volume successfully.
Sep 08 16:42:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fbae0d9c-2d67-44e7-b283-99f359e598e7 tempest-CreateVolumesFromImageTest-2040376671 None] Lock "cinder-316711a5-9067-4356-b458-d327fc89e946-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] GroupSnapshot cf7f84d6-1984-40ad-89ef-6b29352ac48b: creating.
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Group snapshot cf7f84d6-1984-40ad-89ef-6b29352ac48b: creating. {{(pid=87505) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Creating offline snapshot f7818df5-cb38-4ae3-ba86-4c5a945217fc of volume 1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd949cac-7b3a-4253-b15d-beb20dd50823]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:02 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221
Sep 08 16:42:02 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:02 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221" returned: 0 in 0.481s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:02 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc 1G
Sep 08 16:42:02 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:03 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc 1G" returned: 0 in 0.561s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c154278-fa2a-410a-9836-11275e4a9221 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:03 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c154278-fa2a-410a-9836-11275e4a9221 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc
Sep 08 16:42:03 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:03 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c154278-fa2a-410a-9836-11275e4a9221 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc" returned: 0 in 0.386s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:03 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:42:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:03 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc
Sep 08 16:42:03 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:03 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc" returned: 0 in 0.276s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:03 devstack sudo[100394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.info
Sep 08 16:42:03 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:04 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.info" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:04 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 08 16:42:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:04 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.info
Sep 08 16:42:04 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:04 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.info" returned: 0 in 0.278s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:04 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8c1d6923-5145-4947-adae-c2043b5a4811 tempest-GroupSnapshotsTest-783420116 None] group_snapshot cf7f84d6-1984-40ad-89ef-6b29352ac48b: created successfully
Sep 08 16:42:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] group_snapshot cf7f84d6-1984-40ad-89ef-6b29352ac48b: deleting
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] group_snapshot cf7f84d6-1984-40ad-89ef-6b29352ac48b: deleting {{(pid=87505) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-1c154278-fa2a-410a-9836-11275e4a9221" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-1c154278-fa2a-410a-9836-11275e4a9221" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-f7818df5-cb38-4ae3-ba86-4c5a945217fc" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-f7818df5-cb38-4ae3-ba86-4c5a945217fc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Deleting offline snapshot f7818df5-cb38-4ae3-ba86-4c5a945217fc of volume 1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] snapshot_file for this snap is: volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eed349c-93ad-49c0-b534-cef8966a9f54]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:05 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc
Sep 08 16:42:05 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:06 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc" returned: 0 in 0.508s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c154278-fa2a-410a-9836-11275e4a9221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:42:06 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9a50de-88f6-4b90-8779-ff1363c899a7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:06 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221
Sep 08 16:42:06 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:06 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221" returned: 0 in 0.518s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:06 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc
Sep 08 16:42:06 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:07 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (f17b594c-cf35-4afc-b1be-cc0ccb00f6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bb4f09-6565-4f5e-978d-ce00dda0d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc" returned: 0 in 0.531s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:07 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc
Sep 08 16:42:07 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45bb4f09-6565-4f5e-978d-ce00dda0d718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1322537197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac8fb45-074e-4549-bfa1-1e29b9a869fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:07Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b010f19-705f-49c6-a146-0d76c8e5166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b010f19-705f-49c6-a146-0d76c8e5166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3543861a-cb0c-4dee-94a5-155339beaa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3543861a-cb0c-4dee-94a5-155339beaa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac8fb45-074e-4549-bfa1-1e29b9a869fd', 'volume_name': 'volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90935e2a-dc66-4acb-a414-fe920fb5de2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90935e2a-dc66-4acb-a414-fe920fb5de2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acea283c-68ac-4752-989f-daf4c75d606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume aac8fb45-074e-4549-bfa1-1e29b9a869fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd', 'volume_size': 1}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1322537197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac8fb45-074e-4549-bfa1-1e29b9a869fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:07Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Creating volume aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:07 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:07 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd 1073741824
Sep 08 16:42:07 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:07 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221.f7818df5-cb38-4ae3-ba86-4c5a945217fc" returned: 0 in 0.290s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-f7818df5-cb38-4ae3-ba86-4c5a945217fc" released by "_delete_snapshot" :: held 1.990s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-1c154278-fa2a-410a-9836-11275e4a9221" released by "delete_snapshot" :: held 2.025s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:07 devstack cinder-volume[87505]: WARNING cinder.quota [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1374381814 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1374381814, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:42:07 devstack cinder-volume[87505]: WARNING cinder.quota [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1374381814 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1374381814, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] Created reservations ['174f74b6-170f-4019-a900-2941da25455d', '7a4289cc-ef46-40bb-aa46-d30ac6eec03f', '793d1b20-bd0a-4048-bc0c-1c666dce4aa0', 'ca15d103-1c53-4345-9da3-ea88446cd53e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d45c2683-fa50-4ca6-9842-7b7ab0274714 tempest-GroupSnapshotsTest-783420116 None] group_snapshot cf7f84d6-1984-40ad-89ef-6b29352ac48b: deleted successfully
Sep 08 16:42:07 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd 1073741824" returned: 0 in 0.598s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:07 devstack sudo[100429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd
Sep 08 16:42:07 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:08 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd" returned: 0 in 0.316s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acea283c-68ac-4752-989f-daf4c75d606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2c8056-38a1-426e-b4e8-3d3436037544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:08 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd (aac8fb45-074e-4549-bfa1-1e29b9a869fd): created successfully
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d2c8056-38a1-426e-b4e8-3d3436037544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (f17b594c-cf35-4afc-b1be-cc0ccb00f6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:08 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d0230bb1-35f2-4eba-963f-33fa743403a7 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created volume successfully.
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "cinder-quobyte-1c154278-fa2a-410a-9836-11275e4a9221" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-1c154278-fa2a-410a-9836-11275e4a9221" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d9d403-8cfa-4dcb-855c-b58c724a06fc]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:08 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221
Sep 08 16:42:08 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:08 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221" returned: 0 in 0.398s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:08 devstack sudo[100440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221
Sep 08 16:42:08 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:09 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1c154278-fa2a-410a-9836-11275e4a9221" returned: 0 in 0.345s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Lock "cinder-quobyte-1c154278-fa2a-410a-9836-11275e4a9221" released by "delete_volume" :: held 0.833s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Created reservations ['ee516a0c-a2c7-4cd3-9e70-3b55f8d25cb0'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:09 devstack cinder-volume[87505]: WARNING cinder.quota [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1374381814 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1374381814, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Created reservations ['e36e4f96-23e7-49f6-a458-126705084cc9', '99ce62af-6ba6-40be-b946-475e66814e8d', '422f6d9a-f188-4025-83b4-479fc455e663', '78138a5f-4971-40c4-ad76-e6a2305b69d5'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Creating offline snapshot 7e8bc1e1-a680-4780-a807-6bace58eef94 of volume aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bce1bb5-beb6-4ade-9a74-d212e7a7d69f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:09 devstack sudo[100444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:09 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:09 devstack sudo[100443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd
Sep 08 16:42:09 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:10 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:10 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c8c3cb9f-58ff-42f5-940f-dfbb52ee538f tempest-GroupSnapshotsTest-783420116 None] Delete group completed successfully.
Sep 08 16:42:10 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd" returned: 0 in 0.497s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:10 devstack sudo[100452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 1G
Sep 08 16:42:10 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:10 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 1G" returned: 0 in 0.528s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:10 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94
Sep 08 16:42:10 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:11 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94" returned: 0 in 0.421s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:11 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 is being set with open permissions: ugo+rw
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:11 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94
Sep 08 16:42:11 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Flow 'volume_create_manager' (22639bc6-90a3-4b77-868e-6c158db4a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efc6ec2-94c8-476a-a776-6cc995f38590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4efc6ec2-94c8-476a-a776-6cc995f38590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8170c3a6-f45e-474c-a84b-9ff1679b004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ce969f34ca4601aadb6e535a90441a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:11Z,use_quota=True,user_id='d235069a36d6443392675912c544af38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(411d30d8-2fbb-4d1c-ba61-43a34de05219),volume_type_id=411d30d8-2fbb-4d1c-ba61-43a34de05219)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d49db9-6783-4ada-8de4-ba96ea283eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d49db9-6783-4ada-8de4-ba96ea283eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a470074d-b980-4e4e-b8e5-f9bdd521977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:42:11 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94" returned: 0 in 0.349s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:11 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.info
Sep 08 16:42:11 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a470074d-b980-4e4e-b8e5-f9bdd521977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8170c3a6-f45e-474c-a84b-9ff1679b004f', 'volume_name': 'volume-8170c3a6-f45e-474c-a84b-9ff1679b004f', 'volume_size': 1, 'image_id': '29d6c31a-4d91-417a-9379-f0222fe4ab10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29d6c31a-4d91-417a-9379-f0222fe4ab10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5f9fe69c21ce16cd66c24b5f2a40375', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41ce969f34ca4601aadb6e535a90441a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2a0eb205d185fabe57c5c16b30f84608023d0c46ef4cf58fd10546eaed4c6f6acd2820c4660552d339aa861c77e66d6ecc78ab97e9d1818510016de6799a26d', 'id': '29d6c31a-4d91-417a-9379-f0222fe4ab10', 'created_at': datetime.datetime(2026, 9, 8, 14, 42, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 42, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29d6c31a-4d91-417a-9379-f0222fe4ab10/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440e6bce0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698af608-df18-4c9e-8cc5-3d28326e84bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698af608-df18-4c9e-8cc5-3d28326e84bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:12 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad0cf8e-1e38-4665-8784-744810d8ef77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:12 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Volume 8170c3a6-f45e-474c-a84b-9ff1679b004f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8170c3a6-f45e-474c-a84b-9ff1679b004f', 'volume_size': 1, 'image_id': '29d6c31a-4d91-417a-9379-f0222fe4ab10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29d6c31a-4d91-417a-9379-f0222fe4ab10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5f9fe69c21ce16cd66c24b5f2a40375', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41ce969f34ca4601aadb6e535a90441a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2a0eb205d185fabe57c5c16b30f84608023d0c46ef4cf58fd10546eaed4c6f6acd2820c4660552d339aa861c77e66d6ecc78ab97e9d1818510016de6799a26d', 'id': '29d6c31a-4d91-417a-9379-f0222fe4ab10', 'created_at': datetime.datetime(2026, 9, 8, 14, 42, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 42, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29d6c31a-4d91-417a-9379-f0222fe4ab10/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440e6bce0>}
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Trying to clone 8170c3a6-f45e-474c-a84b-9ff1679b004f from image 29d6c31a-4d91-417a-9379-f0222fe4ab10 at location (None, [{'url': 'file:///opt/stack/data/glance/images/29d6c31a-4d91-417a-9379-f0222fe4ab10', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.info" returned: 0 in 0.479s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:12 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.info is being set with open permissions: ugo+rw
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:12 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.info
Sep 08 16:42:12 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:42:12 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Image download 0.00 MB at 0.00 MB/s
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af54714-8d82-4d45-b0af-f74e79b018c4]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:12 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.info" returned: 0 in 0.417s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.848s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-65dac0de-eba9-4979-8445-abb180f9add9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Create snapshot completed successfully
Sep 08 16:42:12 devstack sudo[100471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD
Sep 08 16:42:12 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:12 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:13 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD
Sep 08 16:42:13 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:13 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD" returned: 1 in 0.447s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Temporary image 29d6c31a-4d91-417a-9379-f0222fe4ab10 is fetched for user d235069a36d6443392675912c544af38. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1821bc7-d2a4-4f23-b5bd-a020ef30f415]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:13 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD
Sep 08 16:42:13 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (86f46c97-6440-4437-9170-78bdb8cad59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0c2ae8-8426-4f45-bbe3-567dd5623b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e0c2ae8-8426-4f45-bbe3-567dd5623b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214649159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee906664-2e33-4701-84df-4cb789e1baf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:14Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882d58bb-be26-4039-a511-12c47659696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882d58bb-be26-4039-a511-12c47659696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7056c4d3-bdd6-450f-910b-3e945d860007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7056c4d3-bdd6-450f-910b-3e945d860007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee906664-2e33-4701-84df-4cb789e1baf7', 'volume_name': 'volume-ee906664-2e33-4701-84df-4cb789e1baf7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb22ff-fdbd-4db3-a02b-1f361215427e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bb22ff-fdbd-4db3-a02b-1f361215427e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d06bc92-2da7-4649-947f-70b411d0c121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume ee906664-2e33-4701-84df-4cb789e1baf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee906664-2e33-4701-84df-4cb789e1baf7', 'volume_size': 1}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214649159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee906664-2e33-4701-84df-4cb789e1baf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:14Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Creating volume ee906664-2e33-4701-84df-4cb789e1baf7 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:14 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:14 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD" returned: 0 in 0.539s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:14 devstack sudo[100486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7 1073741824
Sep 08 16:42:14 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Flow 'volume_create_manager' (a9d18c14-fbec-4ed9-9c57-2c47ed986cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6746345b-e9b9-4fa1-b7d6-a1a5c7f0fdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD
Sep 08 16:42:14 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6746345b-e9b9-4fa1-b7d6-a1a5c7f0fdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1085514849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb20bc34-5c00-4e25-9cce-ee8ba42464ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4ed55b910e4c59807cdc5688bfe62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:14Z,use_quota=True,user_id='e6dfed328b2640abb4da53ccfca929fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278dfe1e-1983-4760-a8bd-59d79354a439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278dfe1e-1983-4760-a8bd-59d79354a439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd2518e-353b-4880-91d8-67af6e7df870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cd2518e-353b-4880-91d8-67af6e7df870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb20bc34-5c00-4e25-9cce-ee8ba42464ea', 'volume_name': 'volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1e089-615a-4a34-9daa-837c774446f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1e089-615a-4a34-9daa-837c774446f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df92473-a148-47e4-9299-849fdd34043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Volume fb20bc34-5c00-4e25-9cce-ee8ba42464ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea', 'volume_size': 1}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (290055a5-a881-4f9b-a757-55eb3f1cb8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd122cc8-5a6e-445d-b37b-67cceb9e4f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd122cc8-5a6e-445d-b37b-67cceb9e4f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016249854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34beaf66-0000-4e20-b251-69890df6428a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:14Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc6c129-00f2-407c-a927-4729f511fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dc6c129-00f2-407c-a927-4729f511fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fac7400-39b1-477f-9439-3e8bf577843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fac7400-39b1-477f-9439-3e8bf577843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34beaf66-0000-4e20-b251-69890df6428a', 'volume_name': 'volume-34beaf66-0000-4e20-b251-69890df6428a', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a23ae2-bb56-4cf8-b38c-69e9554ddb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a23ae2-bb56-4cf8-b38c-69e9554ddb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8896e107-130a-402d-8b03-7e272f1350a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume 34beaf66-0000-4e20-b251-69890df6428a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34beaf66-0000-4e20-b251-69890df6428a', 'volume_size': 1}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:14 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD" returned: 1 in 0.566s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:14 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (3843d720-349f-433f-99f1-914a04624d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37da0a09-fe49-4f0a-a0ad-f1a1db31d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7 1073741824" returned: 0 in 0.764s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37da0a09-fe49-4f0a-a0ad-f1a1db31d42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605151096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130a88ff-641f-4cc3-b9c6-7064fa925292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:15Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f7d9fb-93c7-4566-a2bb-231e42ff944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f7d9fb-93c7-4566-a2bb-231e42ff944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b101e9-c737-41b6-8728-8462c423d97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b101e9-c737-41b6-8728-8462c423d97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130a88ff-641f-4cc3-b9c6-7064fa925292', 'volume_name': 'volume-130a88ff-641f-4cc3-b9c6-7064fa925292', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5141cd5a-74a6-4f4b-af58-a7423fbac862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5141cd5a-74a6-4f4b-af58-a7423fbac862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa98bf-b453-45a0-9f3f-0d0260aa7cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:14 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume 130a88ff-641f-4cc3-b9c6-7064fa925292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130a88ff-641f-4cc3-b9c6-7064fa925292', 'volume_size': 1}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:14 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7
Sep 08 16:42:14 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:15 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7" returned: 0 in 0.276s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.870s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1085514849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb20bc34-5c00-4e25-9cce-ee8ba42464ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4ed55b910e4c59807cdc5688bfe62c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:14Z,use_quota=True,user_id='e6dfed328b2640abb4da53ccfca929fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Creating volume fb20bc34-5c00-4e25-9cce-ee8ba42464ea {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:15 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d06bc92-2da7-4649-947f-70b411d0c121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee906664-2e33-4701-84df-4cb789e1baf7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea 1073741824
Sep 08 16:42:15 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4602063-8def-471d-bd96-068a8760a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume volume-ee906664-2e33-4701-84df-4cb789e1baf7 (ee906664-2e33-4701-84df-4cb789e1baf7): created successfully
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4602063-8def-471d-bd96-068a8760a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (86f46c97-6440-4437-9170-78bdb8cad59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (3306134c-811d-4a99-85f6-4d71b2d01785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7e9767-8324-44bb-8d2a-68a795377fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0d548117-fc57-404f-95e2-9bfd3ebecebc tempest-CreateVolumesFromSnapshotTest-561455059 None] Created volume successfully.
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7e9767-8324-44bb-8d2a-68a795377fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1006152491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef41d28c-2360-42eb-8110-e0976a7b36b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:15Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97df459c-59f2-4a72-bf72-fe4b4231d320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97df459c-59f2-4a72-bf72-fe4b4231d320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e99171e-0dfb-4fd8-9063-1adff8e3c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e99171e-0dfb-4fd8-9063-1adff8e3c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef41d28c-2360-42eb-8110-e0976a7b36b7', 'volume_name': 'volume-ef41d28c-2360-42eb-8110-e0976a7b36b7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37870eff-97db-4689-9957-1ab7794d6b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37870eff-97db-4689-9957-1ab7794d6b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daffa9c6-e674-478c-966b-077f339324c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume ef41d28c-2360-42eb-8110-e0976a7b36b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef41d28c-2360-42eb-8110-e0976a7b36b7', 'volume_size': 1}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (19c1cb89-a49f-4506-9e08-5083e25e4b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62aaae86-12ae-4e57-830f-5ef1d1b14882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62aaae86-12ae-4e57-830f-5ef1d1b14882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632399726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cab4090-12ec-4fa6-af19-3943bef04282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:16Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e2c94e-bf96-4812-86ea-8afb5c52901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e2c94e-bf96-4812-86ea-8afb5c52901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c47b6b-45bd-49f6-baef-3068a3728264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c47b6b-45bd-49f6-baef-3068a3728264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cab4090-12ec-4fa6-af19-3943bef04282', 'volume_name': 'volume-0cab4090-12ec-4fa6-af19-3943bef04282', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b642293b-2bde-49a9-a020-88a545ec3fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b642293b-2bde-49a9-a020-88a545ec3fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f896ef6e-14cb-45cf-84ea-bbe59a7bcfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:15 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume 0cab4090-12ec-4fa6-af19-3943bef04282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cab4090-12ec-4fa6-af19-3943bef04282', 'volume_size': 1}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:15 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea 1073741824" returned: 0 in 0.614s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:15 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea
Sep 08 16:42:15 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:16 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" returned: 0 in 0.254s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016249854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34beaf66-0000-4e20-b251-69890df6428a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:14Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Creating volume 34beaf66-0000-4e20-b251-69890df6428a {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:16 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df92473-a148-47e4-9299-849fdd34043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62f94bc-d4d8-41bf-91d5-c51ea13b2bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:16 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a 1073741824
Sep 08 16:42:16 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Volume volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea (fb20bc34-5c00-4e25-9cce-ee8ba42464ea): created successfully
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62f94bc-d4d8-41bf-91d5-c51ea13b2bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Flow 'volume_create_manager' (a9d18c14-fbec-4ed9-9c57-2c47ed986cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-75af939e-565d-4962-b785-f6cbf94295c0 tempest-TestImageHashVerification-473383711 None] Created volume successfully.
Sep 08 16:42:16 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a 1073741824" returned: 0 in 0.439s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:16 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a
Sep 08 16:42:16 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:16 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8170c3a6-f45e-474c-a84b-9ff1679b004f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ce969f34ca4601aadb6e535a90441a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:11Z,use_quota=True,user_id='d235069a36d6443392675912c544af38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(411d30d8-2fbb-4d1c-ba61-43a34de05219),volume_type_id=411d30d8-2fbb-4d1c-ba61-43a34de05219)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Creating volume 8170c3a6-f45e-474c-a84b-9ff1679b004f {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:16 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:16 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f 1073741824
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8896e107-130a-402d-8b03-7e272f1350a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34beaf66-0000-4e20-b251-69890df6428a', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:16 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf03ded-2747-4797-92c2-76d23c6b8c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume volume-34beaf66-0000-4e20-b251-69890df6428a (34beaf66-0000-4e20-b251-69890df6428a): created successfully
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf03ded-2747-4797-92c2-76d23c6b8c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (290055a5-a881-4f9b-a757-55eb3f1cb8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f0f19716-8e2c-4d20-9e38-107760f5c8db tempest-CreateVolumesFromSnapshotTest-561455059 None] Created volume successfully.
Sep 08 16:42:17 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f 1073741824" returned: 0 in 0.518s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:17 devstack sudo[100523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f
Sep 08 16:42:17 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:17 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f" returned: 0 in 0.266s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.839s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-605151096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130a88ff-641f-4cc3-b9c6-7064fa925292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:15Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Creating volume 130a88ff-641f-4cc3-b9c6-7064fa925292 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:17 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:17 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292 1073741824
Sep 08 16:42:17 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Attempting download of 29d6c31a-4d91-417a-9379-f0222fe4ab10 ((None, [{'url': 'file:///opt/stack/data/glance/images/29d6c31a-4d91-417a-9379-f0222fe4ab10', 'metadata': {}}])) to volume 8170c3a6-f45e-474c-a84b-9ff1679b004f. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6677ce3a-d356-46bb-ab56-5bc4e4d4b756]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29d6c31a-4d91-417a-9379-f0222fe4ab10_5qsj8rc6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:17 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29d6c31a-4d91-417a-9379-f0222fe4ab10_5qsj8rc6
Sep 08 16:42:17 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:18 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292 1073741824" returned: 0 in 0.457s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:18 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292
Sep 08 16:42:18 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:18 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29d6c31a-4d91-417a-9379-f0222fe4ab10_5qsj8rc6" returned: 0 in 0.430s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d6c31a-4d91-417a-9379-f0222fe4ab10_5qsj8rc6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:18 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d6c31a-4d91-417a-9379-f0222fe4ab10_5qsj8rc6
Sep 08 16:42:18 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:18 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292" returned: 0 in 0.271s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.145s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1006152491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef41d28c-2360-42eb-8110-e0976a7b36b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:15Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Creating volume ef41d28c-2360-42eb-8110-e0976a7b36b7 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:18 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=230,cinder:INSERT=55,cinder:UPDATE=245,cinder:DELETE=13 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:42:18 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7 1073741824
Sep 08 16:42:18 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa98bf-b453-45a0-9f3f-0d0260aa7cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130a88ff-641f-4cc3-b9c6-7064fa925292', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b75c15-26ce-4bbd-8fd6-8fc1212c41f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=216,cinder:INSERT=70,cinder:UPDATE=266,cinder:DELETE=16 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:42:18 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume volume-130a88ff-641f-4cc3-b9c6-7064fa925292 (130a88ff-641f-4cc3-b9c6-7064fa925292): created successfully
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b75c15-26ce-4bbd-8fd6-8fc1212c41f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (3843d720-349f-433f-99f1-914a04624d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5fd7e457-aae0-4547-a4fb-815a4b79deae tempest-CreateVolumesFromSnapshotTest-561455059 None] Created volume successfully.
Sep 08 16:42:18 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d6c31a-4d91-417a-9379-f0222fe4ab10_5qsj8rc6" returned: 1 in 0.353s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29d6c31a-4d91-417a-9379-f0222fe4ab10_5qsj8rc6' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[94be20b6-79d0-468a-af8f-2d3383245ae4]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:18 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD
Sep 08 16:42:18 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:18 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:18 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7 1073741824" returned: 0 in 0.494s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:19 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7
Sep 08 16:42:19 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:19 devstack sudo[100553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD
Sep 08 16:42:19 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:19 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] 29d6c31a-4d91-417a-9379-f0222fe4ab10 was raw, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:19 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7" returned: 0 in 0.301s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.586s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632399726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cab4090-12ec-4fa6-af19-3943bef04282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bac7cdef23947bb98dd712c31055ad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:16Z,use_quota=True,user_id='9866cd39b04745849c07232320eddbc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Creating volume 0cab4090-12ec-4fa6-af19-3943bef04282 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:19 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f
Sep 08 16:42:19 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:19 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daffa9c6-e674-478c-966b-077f339324c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef41d28c-2360-42eb-8110-e0976a7b36b7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:19 devstack sudo[100563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282 1073741824
Sep 08 16:42:19 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c47df27-bac2-419d-93d3-ad65e5c67f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:19 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume volume-ef41d28c-2360-42eb-8110-e0976a7b36b7 (ef41d28c-2360-42eb-8110-e0976a7b36b7): created successfully
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c47df27-bac2-419d-93d3-ad65e5c67f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (3306134c-811d-4a99-85f6-4d71b2d01785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-83bb95ad-b79b-4047-b2bf-aace90749d22 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created volume successfully.
Sep 08 16:42:19 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282 1073741824" returned: 0 in 0.440s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:19 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f" returned: 0 in 0.481s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29d6c31a-4d91-417a-9379-f0222fe4ab10_l4x7mxx2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:42:19 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Converted 0.00 MB image at 0.00 MB/s
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:19 devstack sudo[100573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f 1G
Sep 08 16:42:19 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:19 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282
Sep 08 16:42:19 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:20 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282" returned: 0 in 0.271s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.900s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f896ef6e-14cb-45cf-84ea-bbe59a7bcfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cab4090-12ec-4fa6-af19-3943bef04282', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d933d71-befc-4d71-80a4-534e9f0e90bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:20 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f 1G" returned: 0 in 0.355s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Downloaded image 29d6c31a-4d91-417a-9379-f0222fe4ab10 ((None, [{'url': 'file:///opt/stack/data/glance/images/29d6c31a-4d91-417a-9379-f0222fe4ab10', 'metadata': {}}])) to volume 8170c3a6-f45e-474c-a84b-9ff1679b004f successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Temporary image 29d6c31a-4d91-417a-9379-f0222fe4ab10 for user d235069a36d6443392675912c544af38 is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Marking volume 8170c3a6-f45e-474c-a84b-9ff1679b004f as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b5925d-e1eb-440a-ba1c-72cc44654fea]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Volume volume-0cab4090-12ec-4fa6-af19-3943bef04282 (0cab4090-12ec-4fa6-af19-3943bef04282): created successfully
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d933d71-befc-4d71-80a4-534e9f0e90bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Flow 'volume_create_manager' (19c1cb89-a49f-4506-9e08-5083e25e4b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Copying metadata from image 29d6c31a-4d91-417a-9379-f0222fe4ab10 to 8170c3a6-f45e-474c-a84b-9ff1679b004f. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Creating volume glance metadata for volume 8170c3a6-f45e-474c-a84b-9ff1679b004f backed by image 29d6c31a-4d91-417a-9379-f0222fe4ab10 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '29d6c31a-4d91-417a-9379-f0222fe4ab10', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e5f9fe69c21ce16cd66c24b5f2a40375', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:42:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-28cc9f23-7b55-44b7-9829-94318bb2ab31 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created volume successfully.
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-0cab4090-12ec-4fa6-af19-3943bef04282-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad0cf8e-1e38-4665-8784-744810d8ef77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8170c3a6-f45e-474c-a84b-9ff1679b004f', 'volume_size': 1, 'image_id': '29d6c31a-4d91-417a-9379-f0222fe4ab10', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29d6c31a-4d91-417a-9379-f0222fe4ab10', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e5f9fe69c21ce16cd66c24b5f2a40375', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41ce969f34ca4601aadb6e535a90441a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b2a0eb205d185fabe57c5c16b30f84608023d0c46ef4cf58fd10546eaed4c6f6acd2820c4660552d339aa861c77e66d6ecc78ab97e9d1818510016de6799a26d', 'id': '29d6c31a-4d91-417a-9379-f0222fe4ab10', 'created_at': datetime.datetime(2026, 9, 8, 14, 42, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 42, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29d6c31a-4d91-417a-9379-f0222fe4ab10/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440e6bce0>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65deffa4-6c5c-4356-9615-cd95d0deaa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:20 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea
Sep 08 16:42:20 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-0cab4090-12ec-4fa6-af19-3943bef04282-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Volume volume-8170c3a6-f45e-474c-a84b-9ff1679b004f (8170c3a6-f45e-474c-a84b-9ff1679b004f): created successfully
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65deffa4-6c5c-4356-9615-cd95d0deaa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Flow 'volume_create_manager' (22639bc6-90a3-4b77-868e-6c158db4a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-be153c62-17f0-4e9e-95c8-c5b3a6ad052d tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Created volume successfully.
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-0cab4090-12ec-4fa6-af19-3943bef04282" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-0cab4090-12ec-4fa6-af19-3943bef04282" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd19ff46-f422-4ce0-b3b9-9bb9dc2cf51e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:20 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282
Sep 08 16:42:20 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:20 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" returned: 0 in 0.496s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7baf04-d107-4f14-aeda-ea867956ce90]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:20 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea
Sep 08 16:42:20 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:20 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282" returned: 0 in 0.389s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:20 devstack sudo[100593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282
Sep 08 16:42:20 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Acquiring lock "cinder-8170c3a6-f45e-474c-a84b-9ff1679b004f-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "cinder-8170c3a6-f45e-474c-a84b-9ff1679b004f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:21 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" returned: 0 in 0.502s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea /opt/stack/data/cinder/conversion/fb20bc34-5c00-4e25-9cce-ee8ba42464ea.temp_image.a9d87bb8-8953-470f-9511-06b5896bc90b9pdw2m7v.img {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Acquiring lock "cinder-quobyte-8170c3a6-f45e-474c-a84b-9ff1679b004f" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:21 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0cab4090-12ec-4fa6-af19-3943bef04282" returned: 0 in 0.314s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:21 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea /opt/stack/data/cinder/conversion/fb20bc34-5c00-4e25-9cce-ee8ba42464ea.temp_image.a9d87bb8-8953-470f-9511-06b5896bc90b9pdw2m7v.img
Sep 08 16:42:21 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-0cab4090-12ec-4fa6-af19-3943bef04282" released by "delete_volume" :: held 0.750s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "cinder-quobyte-8170c3a6-f45e-474c-a84b-9ff1679b004f" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d999e54-aa7a-4337-bf7d-74da185aa6d5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Created reservations ['78fd436f-c833-480d-98da-01c2b91dfacd', '8daa0946-1ee1-435e-892c-492f17af3968', '2fcfb517-cdb7-4c17-a9d9-b12185792a7f', '23530287-2da1-4806-a3e0-fde9f869fbdc'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:21 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f
Sep 08 16:42:21 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:21 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:21 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-ef41d28c-2360-42eb-8110-e0976a7b36b7-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-ef41d28c-2360-42eb-8110-e0976a7b36b7-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:21 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f" returned: 0 in 0.572s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:21 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:21 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f
Sep 08 16:42:21 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-ef41d28c-2360-42eb-8110-e0976a7b36b7" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.471s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:21 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Deleted volume successfully.
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-ef41d28c-2360-42eb-8110-e0976a7b36b7" acquired by "delete_volume" :: waited 0.097s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d618b13-51e5-41a3-94e5-5577310dcf4c tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-0cab4090-12ec-4fa6-af19-3943bef04282-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6dd74-0f70-452c-86fb-923eca7c240f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:22 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8170c3a6-f45e-474c-a84b-9ff1679b004f" returned: 0 in 0.604s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:22 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7
Sep 08 16:42:22 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "cinder-quobyte-8170c3a6-f45e-474c-a84b-9ff1679b004f" released by "delete_volume" :: held 1.263s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:22 devstack cinder-volume[87505]: WARNING cinder.quota [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:42:22 devstack cinder-volume[87505]: WARNING cinder.quota [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Created reservations ['fd035d7a-0edf-4d27-8f46-90367f3ac2ff', '63006de5-559e-4927-87f5-6fc3db1c234b', 'fa4c2fe8-219c-4a50-9e07-05bca5017f06', 'f5dcf0c9-5bde-4835-9d4b-81ea3ce1d009'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:22 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:22 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:23 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.520s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:23 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Deleted volume successfully.
Sep 08 16:42:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2842260c-e1e2-4534-aab7-0460031e7827 tempest-VolumeAndVolumeTypeFromImageTest-69403005 None] Lock "cinder-8170c3a6-f45e-474c-a84b-9ff1679b004f-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:23 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7" returned: 0 in 1.669s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:23 devstack sudo[100632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7
Sep 08 16:42:23 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:24 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ef41d28c-2360-42eb-8110-e0976a7b36b7" returned: 0 in 0.607s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-ef41d28c-2360-42eb-8110-e0976a7b36b7" released by "delete_volume" :: held 2.434s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Created reservations ['91c4f859-5a4b-48ef-848c-ea469725606d', '03464f9e-b330-478f-ba91-32be74dfe7cc', 'dbded67b-0768-493e-96be-b7a300a7e371', 'ea079483-e75e-43c5-a891-d81107a64d82'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:25 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:25 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-130a88ff-641f-4cc3-b9c6-7064fa925292-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-130a88ff-641f-4cc3-b9c6-7064fa925292-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-130a88ff-641f-4cc3-b9c6-7064fa925292" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-130a88ff-641f-4cc3-b9c6-7064fa925292" acquired by "delete_volume" :: waited 0.057s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d46453-b4fa-4be1-830c-d89adc720c4a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:25 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.949s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Deleted volume successfully.
Sep 08 16:42:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-47edcf2c-ecfe-46b0-935a-675f338cd91e tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-ef41d28c-2360-42eb-8110-e0976a7b36b7-delete_volume" released by "delete_volume" :: held 4.137s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:26 devstack sudo[100637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292
Sep 08 16:42:26 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:26 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292" returned: 0 in 1.022s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:26 devstack sudo[100643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292
Sep 08 16:42:26 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:26 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea /opt/stack/data/cinder/conversion/fb20bc34-5c00-4e25-9cce-ee8ba42464ea.temp_image.a9d87bb8-8953-470f-9511-06b5896bc90b9pdw2m7v.img" returned: 0 in 5.713s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:26 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c85b9-71c3-4f37-b5ae-a18cc5b6ee1d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:27 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea
Sep 08 16:42:27 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:27 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-130a88ff-641f-4cc3-b9c6-7064fa925292" returned: 0 in 0.387s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-130a88ff-641f-4cc3-b9c6-7064fa925292" released by "delete_volume" :: held 1.531s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created reservations ['83d7fa05-06f6-460a-a7d3-0001e9763763', '5943238a-611a-4a39-963b-5c0669835fa3', '859e50ae-2892-4d5f-bcc4-659b9ef701db', '6c510509-307a-4d55-8b70-ce79724499d1'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:27 devstack sudo[100650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:27 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:27 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:27 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.294s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Deleted volume successfully.
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" returned: 0 in 0.661s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/conversion/fb20bc34-5c00-4e25-9cce-ee8ba42464ea.temp_image.a9d87bb8-8953-470f-9511-06b5896bc90b9pdw2m7v.img {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:42:27 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Converted 1024.00 MB image at 179.19 MB/s
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] a9d87bb8-8953-470f-9511-06b5896bc90b was raw, no need to convert to raw {{(pid=87505) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4042dbec-5078-4d71-871d-c3949a4cc9a9 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-130a88ff-641f-4cc3-b9c6-7064fa925292-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-34beaf66-0000-4e20-b251-69890df6428a-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-34beaf66-0000-4e20-b251-69890df6428a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-34beaf66-0000-4e20-b251-69890df6428a" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-34beaf66-0000-4e20-b251-69890df6428a" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41468c-837d-43f0-830b-0fba82ea9cda]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:28 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a
Sep 08 16:42:28 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:28 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a" returned: 0 in 0.444s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:28 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a
Sep 08 16:42:28 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:28 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-34beaf66-0000-4e20-b251-69890df6428a" returned: 0 in 0.314s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-34beaf66-0000-4e20-b251-69890df6428a" released by "delete_volume" :: held 0.811s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created reservations ['aac6b7c4-9a19-4174-84d6-7d0ece15f13c', '93133149-c03e-4e4a-a852-0c454e9ca164', 'df67e223-e707-4374-9242-14163093200f', '8db14d4b-16dc-4c70-82c9-652d867e7b1a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:28 devstack sudo[100663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:28 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-ee906664-2e33-4701-84df-4cb789e1baf7-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-ee906664-2e33-4701-84df-4cb789e1baf7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-ee906664-2e33-4701-84df-4cb789e1baf7" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-ee906664-2e33-4701-84df-4cb789e1baf7" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[db928f8a-c8df-4b8e-9f6d-5b10dd6cead9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7f3ed26c-574c-4f01-84b4-af4d7ee629fc tempest-GroupsTest-1872208960 None] Group tempest-Group1-1644858450: creating
Sep 08 16:42:29 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.497s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Deleted volume successfully.
Sep 08 16:42:29 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7
Sep 08 16:42:29 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7f3ed26c-574c-4f01-84b4-af4d7ee629fc tempest-GroupsTest-1872208960 None] Group tempest-Group1-1644858450: created successfully
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2b279cc-aca2-4b99-9668-b8d4f0378974 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-34beaf66-0000-4e20-b251-69890df6428a-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7f3ed26c-574c-4f01-84b4-af4d7ee629fc tempest-GroupsTest-1872208960 None] Create group completed successfully.
Sep 08 16:42:29 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7" returned: 0 in 0.495s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:29 devstack sudo[100672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7
Sep 08 16:42:29 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:30 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee906664-2e33-4701-84df-4cb789e1baf7" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-ee906664-2e33-4701-84df-4cb789e1baf7" released by "delete_volume" :: held 0.860s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created reservations ['59f142c0-18d3-4a38-a73d-a52575ba7ea7', '1849fd2d-39e8-4a99-a2d0-d68acea89a34', '78640aba-8fae-4e6d-922e-e6e792108a8a', 'f94d7642-a8a1-47f7-b3e3-e83357b6f7be'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:30 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:30 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-7e8bc1e1-a680-4780-a807-6bace58eef94-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-7e8bc1e1-a680-4780-a807-6bace58eef94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-aac8fb45-074e-4549-bfa1-1e29b9a869fd" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-aac8fb45-074e-4549-bfa1-1e29b9a869fd" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-7e8bc1e1-a680-4780-a807-6bace58eef94" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-7e8bc1e1-a680-4780-a807-6bace58eef94" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Deleting offline snapshot 7e8bc1e1-a680-4780-a807-6bace58eef94 of volume aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] snapshot_file for this snap is: volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e617a-bc2d-474d-b60a-b455e0c20262]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:30 devstack sudo[100677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94
Sep 08 16:42:30 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:30 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-05e6b77d-c3d2-4c3a-8b6f-beff4cb28e9f tempest-GroupsTest-1872208960 None] Group tempest-Group2-490403253: creating
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.565s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Deleted volume successfully.
Sep 08 16:42:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-05e6b77d-c3d2-4c3a-8b6f-beff4cb28e9f tempest-GroupsTest-1872208960 None] Group tempest-Group2-490403253: created successfully
Sep 08 16:42:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-89966a0f-33c3-4a0f-af89-7d7a99f176b0 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-ee906664-2e33-4701-84df-4cb789e1baf7-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-05e6b77d-c3d2-4c3a-8b6f-beff4cb28e9f tempest-GroupsTest-1872208960 None] Create group completed successfully.
Sep 08 16:42:31 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94" returned: 0 in 0.519s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:42:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdc71f4-8c26-49dc-8ceb-810fa5d55e35]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:31 devstack sudo[100685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd
Sep 08 16:42:31 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:31 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd" returned: 0 in 0.519s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:31 devstack sudo[100691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94
Sep 08 16:42:31 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:32 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94" returned: 0 in 0.468s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:32 devstack sudo[100696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94
Sep 08 16:42:32 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:32 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd.7e8bc1e1-a680-4780-a807-6bace58eef94" returned: 0 in 0.386s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-7e8bc1e1-a680-4780-a807-6bace58eef94" released by "_delete_snapshot" :: held 2.117s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-aac8fb45-074e-4549-bfa1-1e29b9a869fd" released by "delete_snapshot" :: held 2.165s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Flow 'volume_create_manager' (d0eea5b7-aa4d-45eb-a6ca-51267056121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2604a2-3184-49a5-b374-212712be7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2604a2-3184-49a5-b374-212712be7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874997778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f2a989f-cf49-44c7-8c80-0fe5b341be0e,host='devstack@QuobyteHD#QuobyteHD',id=2bd13336-5aea-43f8-ac87-6606f249c605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05af1919542348bdb050d18a7e1b120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:33Z,use_quota=True,user_id='0cc33bba4ab74248ae9984c59f2849cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e18a169-986b-43a0-b1e5-7a4f40d07af5),volume_type_id=5e18a169-986b-43a0-b1e5-7a4f40d07af5)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d15cc2-649e-4e2a-af89-82773a1be9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d15cc2-649e-4e2a-af89-82773a1be9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9259d6f1-8e49-4365-b042-306d84e1f47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9259d6f1-8e49-4365-b042-306d84e1f47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd13336-5aea-43f8-ac87-6606f249c605', 'volume_name': 'volume-2bd13336-5aea-43f8-ac87-6606f249c605', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ebeb27-da81-4b21-a5c2-f9f609c024be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ebeb27-da81-4b21-a5c2-f9f609c024be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0468bbf1-28b2-442e-b0f6-ea0b871428d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:32 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Volume 2bd13336-5aea-43f8-ac87-6606f249c605: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd13336-5aea-43f8-ac87-6606f249c605', 'volume_size': 1}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created reservations ['19d3530d-fd07-4d8c-ae73-d77327e23126', '6cdab995-6e44-4700-99e1-f5b726af11e8', '233615ae-989a-4ef5-abf4-359602e9ab32', '78dc9d0b-c107-46f3-80c3-600cc0bbc47b'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:32 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Delete snapshot completed successfully.
Sep 08 16:42:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e4c0c589-64df-4f75-a0f1-97b6e985f8c4 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-7e8bc1e1-a680-4780-a807-6bace58eef94-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-aac8fb45-074e-4549-bfa1-1e29b9a869fd-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-aac8fb45-074e-4549-bfa1-1e29b9a869fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "cinder-quobyte-aac8fb45-074e-4549-bfa1-1e29b9a869fd" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-aac8fb45-074e-4549-bfa1-1e29b9a869fd" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c30d13c-2ec9-42d8-8710-ec8bbc2dd5c6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:33 devstack sudo[100700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd
Sep 08 16:42:33 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:34 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Flow 'volume_create_manager' (dba21b3a-d88c-4e2f-8a9e-78c176807006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d41365-a14a-4661-a347-e7978f0e4d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd" returned: 0 in 0.565s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d41365-a14a-4661-a347-e7978f0e4d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f191f1-7585-49ee-8011-e3969ce30e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6874e68daa74419b8636ef5aafb18fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:34Z,use_quota=True,user_id='40719964895240c69e8048dfeb9accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bede22-e4c3-4561-9c16-e872f6895c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:34 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd
Sep 08 16:42:34 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bede22-e4c3-4561-9c16-e872f6895c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5592d940-50e9-4f86-8137-8f589eb56356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:42:34 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-aac8fb45-074e-4549-bfa1-1e29b9a869fd" returned: 0 in 0.284s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-quobyte-aac8fb45-074e-4549-bfa1-1e29b9a869fd" released by "delete_volume" :: held 0.940s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5592d940-50e9-4f86-8137-8f589eb56356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65f191f1-7585-49ee-8011-e3969ce30e32', 'volume_name': 'volume-65f191f1-7585-49ee-8011-e3969ce30e32', 'volume_size': 1, 'image_id': '904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '339eeb56bedf1a04f6bb2b59e549a3ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6874e68daa74419b8636ef5aafb18fe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a334f4a55030e9f024e2fb82b8c9e44be80e4c9f0f07a147fa1dc009ab8ca6c43c0e6bd32a92b77f8fd308d48fe3494f60a6d2c5fbec9e758019600c856b627e', 'id': '904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'created_at': datetime.datetime(2026, 9, 8, 14, 42, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 42, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34363ef620>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f884d6-0c20-4b1f-ae2c-c1d46a2a25a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f884d6-0c20-4b1f-ae2c-c1d46a2a25a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e54003b-b2de-478f-9c48-45bfbbf15980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Volume 65f191f1-7585-49ee-8011-e3969ce30e32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65f191f1-7585-49ee-8011-e3969ce30e32', 'volume_size': 1, 'image_id': '904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '339eeb56bedf1a04f6bb2b59e549a3ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6874e68daa74419b8636ef5aafb18fe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a334f4a55030e9f024e2fb82b8c9e44be80e4c9f0f07a147fa1dc009ab8ca6c43c0e6bd32a92b77f8fd308d48fe3494f60a6d2c5fbec9e758019600c856b627e', 'id': '904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'created_at': datetime.datetime(2026, 9, 8, 14, 42, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 42, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34363ef620>}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Trying to clone 65f191f1-7585-49ee-8011-e3969ce30e32 from image 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 at location (None, [{'url': 'file:///opt/stack/data/glance/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Created reservations ['0d52c17c-c72d-433c-bdae-7640604e67d7', 'd579fca1-89c4-49ca-99b9-2538a9cd9a08', '992e5657-e3b6-41ba-8c8a-3d7f1653fd70', 'e9760d42-ec12-4d1c-b334-300dcb74a783'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:42:34 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Image download 0.00 MB at 0.00 MB/s
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:34 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:34 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f84bb7-22c9-454b-9026-a2053de95c6a]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:35 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD
Sep 08 16:42:35 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:35 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.311s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Deleted volume successfully.
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b5f43ba8-eb8b-4fd7-86b6-0a1db69cec78 tempest-CreateVolumesFromSnapshotTest-561455059 None] Lock "cinder-aac8fb45-074e-4549-bfa1-1e29b9a869fd-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:35 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:35 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD
Sep 08 16:42:35 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:35 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Temporary image 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 is fetched for user 40719964895240c69e8048dfeb9accb7. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab455948-77f9-4b4a-b680-8138f656d852]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:35 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD
Sep 08 16:42:35 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:36 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:36 devstack sudo[100724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD
Sep 08 16:42:36 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:36 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:45 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=78,cinder:DELETE=3,cinder:INSERT=21,cinder:SELECT=50 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:42:45 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=67,cinder:DELETE=8,cinder:SELECT=60,cinder:INSERT=23 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.624s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Uploaded volume to glance image-id: a9d87bb8-8953-470f-9511-06b5896bc90b. {{(pid=87505) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.052s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6f2a989f-cf49-44c7-8c80-0fe5b341be0e,created_at=2026-09-08T14:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874997778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f2a989f-cf49-44c7-8c80-0fe5b341be0e,host='devstack@QuobyteHD#QuobyteHD',id=2bd13336-5aea-43f8-ac87-6606f249c605,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05af1919542348bdb050d18a7e1b120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:33Z,use_quota=True,user_id='0cc33bba4ab74248ae9984c59f2849cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e18a169-986b-43a0-b1e5-7a4f40d07af5),volume_type_id=5e18a169-986b-43a0-b1e5-7a4f40d07af5)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Creating volume 2bd13336-5aea-43f8-ac87-6606f249c605 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:48 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:48 devstack sudo[100732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605 1073741824
Sep 08 16:42:48 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b6178145-e731-4449-9cab-6c64099412da tempest-TestImageHashVerification-473383711 None] Copy volume to image completed successfully.
Sep 08 16:42:49 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605 1073741824" returned: 0 in 0.442s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:49 devstack sudo[100738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605
Sep 08 16:42:49 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Acquiring lock "cinder-fb20bc34-5c00-4e25-9cce-ee8ba42464ea-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Lock "cinder-fb20bc34-5c00-4e25-9cce-ee8ba42464ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Acquiring lock "cinder-quobyte-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Lock "cinder-quobyte-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:49 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605" returned: 0 in 0.251s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.027s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f191f1-7585-49ee-8011-e3969ce30e32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6874e68daa74419b8636ef5aafb18fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:34Z,use_quota=True,user_id='40719964895240c69e8048dfeb9accb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Creating volume 65f191f1-7585-49ee-8011-e3969ce30e32 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:49 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[32641846-9943-4cf0-93fd-88388525296e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:49 devstack sudo[100741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 1073741824
Sep 08 16:42:49 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0468bbf1-28b2-442e-b0f6-ea0b871428d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd13336-5aea-43f8-ac87-6606f249c605', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf17d25-7985-4d3d-936b-e9079f56c236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Volume volume-2bd13336-5aea-43f8-ac87-6606f249c605 (2bd13336-5aea-43f8-ac87-6606f249c605): created successfully
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf17d25-7985-4d3d-936b-e9079f56c236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Flow 'volume_create_manager' (d0eea5b7-aa4d-45eb-a6ca-51267056121f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e309eb12-6a96-41ed-aed9-74280f394f45 tempest-GroupsTest-1872208960 None] Created volume successfully.
Sep 08 16:42:49 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea
Sep 08 16:42:49 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:49 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" returned: 0 in 0.359s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:49 devstack sudo[100751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea
Sep 08 16:42:49 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:49 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 1073741824" returned: 0 in 0.430s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:50 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32
Sep 08 16:42:50 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:50 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" returned: 0 in 0.235s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Lock "cinder-quobyte-fb20bc34-5c00-4e25-9cce-ee8ba42464ea" released by "delete_volume" :: held 0.664s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Created reservations ['4ea6fa0e-6780-4deb-86ab-8cc53a06c904', '714e1426-57ac-490f-96e3-c30e7da4f5f4', 'ef71fbbf-18d7-4302-8940-10ccd48d113d', '2f1b5667-225a-4cf7-9e7f-ee73ce4718eb'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:50 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32" returned: 0 in 0.274s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Attempting download of 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 ((None, [{'url': 'file:///opt/stack/data/glance/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'metadata': {}}])) to volume 65f191f1-7585-49ee-8011-e3969ce30e32. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:50 devstack sudo[100758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:50 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d28d33-5aa2-44d6-899f-ab2fdb72c2b3]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_25kjwx_o {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:50 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_25kjwx_o
Sep 08 16:42:50 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:50 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.264s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Deleted volume successfully.
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1db2fafd-e29e-41d6-b0ec-286dab6c326a tempest-TestImageHashVerification-473383711 None] Lock "cinder-fb20bc34-5c00-4e25-9cce-ee8ba42464ea-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:50 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_25kjwx_o" returned: 0 in 0.371s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_25kjwx_o {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:50 devstack sudo[100765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_25kjwx_o
Sep 08 16:42:50 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Acquiring lock "cinder-quobyte-2bd13336-5aea-43f8-ac87-6606f249c605" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Lock "cinder-quobyte-2bd13336-5aea-43f8-ac87-6606f249c605" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb927fb-21f3-4440-81c7-eb5ff5ca7ce3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:51 devstack sudo[100767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605
Sep 08 16:42:51 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:51 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_25kjwx_o" returned: 1 in 0.355s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_25kjwx_o' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c2490e-c1d9-4943-a244-c0380b2a9634]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:51 devstack sudo[100771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD
Sep 08 16:42:51 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:51 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605" returned: 0 in 0.400s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:51 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605
Sep 08 16:42:51 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:51 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:51 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD
Sep 08 16:42:51 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:51 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2bd13336-5aea-43f8-ac87-6606f249c605" returned: 0 in 0.283s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Lock "cinder-quobyte-2bd13336-5aea-43f8-ac87-6606f249c605" released by "delete_volume" :: held 0.742s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Created reservations ['cfc6b835-b1cc-42b2-bc4c-477e70c1d8e0'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:51 devstack cinder-volume[87505]: WARNING cinder.quota [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1120055379 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1120055379, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:42:51 devstack cinder-volume[87505]: WARNING cinder.quota [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1120055379 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1120055379, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Created reservations ['47238d45-5df6-48fe-9a6d-c5634bf53dc6', 'd4953afb-722e-43a3-81da-0ff81a3f4692', 'fde485cf-950f-4b94-9bc4-bab1c384a5ad', 'a8040f64-2e51-4915-8912-ef18342aa22a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:51 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 was raw, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:51 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32
Sep 08 16:42:51 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:51 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:51 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:52 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.299s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1c978812-80c4-437c-b056-c14e5478ef5e tempest-GroupsTest-1872208960 None] Delete group completed successfully.
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Created reservations ['d487df9a-986f-4d5c-9e92-44996b2b47ea'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:52 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32" returned: 0 in 0.571s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_904ab58d-1ff2-4bff-9ad5-cf3872cf2299_3cj6s2sidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:42:52 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Converted 0.00 MB image at 0.00 MB/s
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:52 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 1G
Sep 08 16:42:52 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:52 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:52 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:52 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 1G" returned: 0 in 0.326s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Downloaded image 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 ((None, [{'url': 'file:///opt/stack/data/glance/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'metadata': {}}])) to volume 65f191f1-7585-49ee-8011-e3969ce30e32 successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Temporary image 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 for user 40719964895240c69e8048dfeb9accb7 is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Marking volume 65f191f1-7585-49ee-8011-e3969ce30e32 as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:42:52 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.261s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Copying metadata from image 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 to 65f191f1-7585-49ee-8011-e3969ce30e32. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Creating volume glance metadata for volume 65f191f1-7585-49ee-8011-e3969ce30e32 backed by image 904ab58d-1ff2-4bff-9ad5-cf3872cf2299 with: {'image_id': '904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '339eeb56bedf1a04f6bb2b59e549a3ee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:42:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-59da8773-c815-44c1-b057-ecbee0e4aff7 tempest-GroupsTest-1872208960 None] Delete group completed successfully.
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e54003b-b2de-478f-9c48-45bfbbf15980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f191f1-7585-49ee-8011-e3969ce30e32', 'volume_size': 1, 'image_id': '904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '339eeb56bedf1a04f6bb2b59e549a3ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6874e68daa74419b8636ef5aafb18fe0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a334f4a55030e9f024e2fb82b8c9e44be80e4c9f0f07a147fa1dc009ab8ca6c43c0e6bd32a92b77f8fd308d48fe3494f60a6d2c5fbec9e758019600c856b627e', 'id': '904ab58d-1ff2-4bff-9ad5-cf3872cf2299', 'created_at': datetime.datetime(2026, 9, 8, 14, 42, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 42, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/904ab58d-1ff2-4bff-9ad5-cf3872cf2299/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34363ef620>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468c7e83-1bd0-458f-b7c8-c2d88a2fa977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Volume volume-65f191f1-7585-49ee-8011-e3969ce30e32 (65f191f1-7585-49ee-8011-e3969ce30e32): created successfully
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (468c7e83-1bd0-458f-b7c8-c2d88a2fa977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Flow 'volume_create_manager' (dba21b3a-d88c-4e2f-8a9e-78c176807006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-37e22f9c-0354-4adf-bddf-b6f7b4bb8739 tempest-VolumeImageDependencyTests-497326032 None] Created volume successfully.
Sep 08 16:42:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Acquiring lock "cinder-65f191f1-7585-49ee-8011-e3969ce30e32-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Lock "cinder-65f191f1-7585-49ee-8011-e3969ce30e32-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Acquiring lock "cinder-quobyte-65f191f1-7585-49ee-8011-e3969ce30e32" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:42:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Lock "cinder-quobyte-65f191f1-7585-49ee-8011-e3969ce30e32" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:42:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedc22eb-a63e-403a-9bcb-771c337ee017]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:42:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:53 devstack sudo[100805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32
Sep 08 16:42:53 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-47799413-5c1f-486e-82f5-6e1357c94370 tempest-GroupsTest-1872208960 None] Group tempest-GroupsTest-Group-932355987: creating
Sep 08 16:42:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-47799413-5c1f-486e-82f5-6e1357c94370 tempest-GroupsTest-1872208960 None] Group tempest-GroupsTest-Group-932355987: created successfully
Sep 08 16:42:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-47799413-5c1f-486e-82f5-6e1357c94370 tempest-GroupsTest-1872208960 None] Create group completed successfully.
Sep 08 16:42:54 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32" returned: 0 in 0.375s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:54 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32
Sep 08 16:42:54 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:54 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-65f191f1-7585-49ee-8011-e3969ce30e32" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Lock "cinder-quobyte-65f191f1-7585-49ee-8011-e3969ce30e32" released by "delete_volume" :: held 0.699s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Created reservations ['9930fda9-b4b4-4635-87ab-f2d65a866ec8', '52c6fa5a-b956-45bd-a6a8-6d9fdf8751aa', 'e3602379-233b-497b-9f4f-5e3964db59d8', '90d2ab63-eea7-43dd-a25f-0b0175508a40'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:54 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:54 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:54 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.291s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Deleted volume successfully.
Sep 08 16:42:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-515f8140-6397-4c5a-9b13-e86581a69fb4 tempest-VolumeImageDependencyTests-497326032 None] Lock "cinder-65f191f1-7585-49ee-8011-e3969ce30e32-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Flow 'volume_create_manager' (6031e0fe-3a81-4505-9e75-51189894d8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931fe227-2fdc-4161-8051-6192c998e7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (931fe227-2fdc-4161-8051-6192c998e7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719617202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df9bbf59-b2f6-49e9-8dbd-885f4fa1645b,host='devstack@QuobyteHD#QuobyteHD',id=5deeaa99-ba80-45e9-a5d1-1b94077c7b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05af1919542348bdb050d18a7e1b120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:56Z,use_quota=True,user_id='0cc33bba4ab74248ae9984c59f2849cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5bcce6-b374-401a-b11e-d037459bb381),volume_type_id=ad5bcce6-b374-401a-b11e-d037459bb381)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e2c9f4-6140-4285-b87c-16914a87ee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e2c9f4-6140-4285-b87c-16914a87ee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c58644-6241-4000-839f-d544bbbf08de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c58644-6241-4000-839f-d544bbbf08de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5deeaa99-ba80-45e9-a5d1-1b94077c7b10', 'volume_name': 'volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2b61d6-3c68-4bbb-8238-c78d9d45474a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2b61d6-3c68-4bbb-8238-c78d9d45474a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0170391c-eb99-4911-8ad8-349329f98cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Volume 5deeaa99-ba80-45e9-a5d1-1b94077c7b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10', 'volume_size': 1}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df9bbf59-b2f6-49e9-8dbd-885f4fa1645b,created_at=2026-09-08T14:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719617202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df9bbf59-b2f6-49e9-8dbd-885f4fa1645b,host='devstack@QuobyteHD#QuobyteHD',id=5deeaa99-ba80-45e9-a5d1-1b94077c7b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05af1919542348bdb050d18a7e1b120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:56Z,use_quota=True,user_id='0cc33bba4ab74248ae9984c59f2849cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5bcce6-b374-401a-b11e-d037459bb381),volume_type_id=ad5bcce6-b374-401a-b11e-d037459bb381)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Creating volume 5deeaa99-ba80-45e9-a5d1-1b94077c7b10 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:55 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:55 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10 1073741824
Sep 08 16:42:55 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:56 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10 1073741824" returned: 0 in 0.473s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:56 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10
Sep 08 16:42:56 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:56 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10" returned: 0 in 0.292s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:56 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:42:56 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0170391c-eb99-4911-8ad8-349329f98cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f5a211-b1c3-4cf9-a42f-2e7620b49d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:56 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Volume volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10 (5deeaa99-ba80-45e9-a5d1-1b94077c7b10): created successfully
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f5a211-b1c3-4cf9-a42f-2e7620b49d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Flow 'volume_create_manager' (6031e0fe-3a81-4505-9e75-51189894d8ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c0797d99-5cc1-4707-986c-e891a5190ee7 tempest-GroupsTest-1872208960 None] Created volume successfully.
Sep 08 16:42:56 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:42:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Flow 'volume_create_manager' (28dcc168-43e1-4394-ba5a-74fa7961415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf89f08-b96d-4587-b861-713fb1ee9199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf89f08-b96d-4587-b861-713fb1ee9199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2019061638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df9bbf59-b2f6-49e9-8dbd-885f4fa1645b,host='devstack@QuobyteHD#QuobyteHD',id=801b1505-6a65-4d73-9f68-65293c95ef66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05af1919542348bdb050d18a7e1b120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:59Z,use_quota=True,user_id='0cc33bba4ab74248ae9984c59f2849cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5bcce6-b374-401a-b11e-d037459bb381),volume_type_id=ad5bcce6-b374-401a-b11e-d037459bb381)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6111ee07-c3a0-40f4-8fdb-db27f2a7c494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6111ee07-c3a0-40f4-8fdb-db27f2a7c494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff450cd-3b18-41de-820b-a3a66507e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff450cd-3b18-41de-820b-a3a66507e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '801b1505-6a65-4d73-9f68-65293c95ef66', 'volume_name': 'volume-801b1505-6a65-4d73-9f68-65293c95ef66', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf0a16d-0dcb-4680-bf84-cb0e852a70be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf0a16d-0dcb-4680-bf84-cb0e852a70be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3cd9112-e9db-4b76-a494-549a6918c193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:58 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Volume 801b1505-6a65-4d73-9f68-65293c95ef66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-801b1505-6a65-4d73-9f68-65293c95ef66', 'volume_size': 1}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df9bbf59-b2f6-49e9-8dbd-885f4fa1645b,created_at=2026-09-08T14:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2019061638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df9bbf59-b2f6-49e9-8dbd-885f4fa1645b,host='devstack@QuobyteHD#QuobyteHD',id=801b1505-6a65-4d73-9f68-65293c95ef66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05af1919542348bdb050d18a7e1b120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:42:59Z,use_quota=True,user_id='0cc33bba4ab74248ae9984c59f2849cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad5bcce6-b374-401a-b11e-d037459bb381),volume_type_id=ad5bcce6-b374-401a-b11e-d037459bb381)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Creating volume 801b1505-6a65-4d73-9f68-65293c95ef66 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:42:58 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:42:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:58 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66 1073741824
Sep 08 16:42:58 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:59 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66 1073741824" returned: 0 in 0.453s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:42:59 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66
Sep 08 16:42:59 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:42:59 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66" returned: 0 in 0.271s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3cd9112-e9db-4b76-a494-549a6918c193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-801b1505-6a65-4d73-9f68-65293c95ef66', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125eb182-0795-40b8-a52d-b1399add9e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:42:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Volume volume-801b1505-6a65-4d73-9f68-65293c95ef66 (801b1505-6a65-4d73-9f68-65293c95ef66): created successfully
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (125eb182-0795-40b8-a52d-b1399add9e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:42:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Flow 'volume_create_manager' (28dcc168-43e1-4394-ba5a-74fa7961415e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:42:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-687eb7f5-e272-4f8c-831e-21ca73796e1b tempest-GroupsTest-1872208960 None] Created volume successfully.
Sep 08 16:43:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a98f64ef-3128-4f61-9902-d62b8cbfceaf tempest-GroupsTest-1872208960 None] Update group completed successfully.
Sep 08 16:43:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-adbc3d39-5356-4b48-953e-dd0486a6c681 tempest-GroupsTest-1872208960 None] Update group completed successfully.
Sep 08 16:43:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Acquiring lock "cinder-quobyte-5deeaa99-ba80-45e9-a5d1-1b94077c7b10" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Lock "cinder-quobyte-5deeaa99-ba80-45e9-a5d1-1b94077c7b10" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df530cf-5f27-4a73-b80d-06dacf29de54]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:03 devstack sudo[100876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10
Sep 08 16:43:03 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:03 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10" returned: 0 in 0.410s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:03 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10
Sep 08 16:43:03 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:04 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5deeaa99-ba80-45e9-a5d1-1b94077c7b10" returned: 0 in 0.306s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Lock "cinder-quobyte-5deeaa99-ba80-45e9-a5d1-1b94077c7b10" released by "delete_volume" :: held 0.776s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Acquiring lock "cinder-quobyte-801b1505-6a65-4d73-9f68-65293c95ef66" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Lock "cinder-quobyte-801b1505-6a65-4d73-9f68-65293c95ef66" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0217887-cffe-41db-9c7c-2340a9e1a643]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (e3112339-8405-43c4-9e2f-807ffa5d7e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be88ad67-8b55-465a-8523-005c9a1ffb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be88ad67-8b55-465a-8523-005c9a1ffb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922914041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91c1353-9ba0-4354-a082-bcfa9732ec47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:04Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d4edd1-46cf-40dd-a699-c3c2f3b70df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:04 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66
Sep 08 16:43:04 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d4edd1-46cf-40dd-a699-c3c2f3b70df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69e2051-9e43-432c-8ec0-419500a023ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69e2051-9e43-432c-8ec0-419500a023ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91c1353-9ba0-4354-a082-bcfa9732ec47', 'volume_name': 'volume-e91c1353-9ba0-4354-a082-bcfa9732ec47', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f315d65-2ac2-4f6e-bb89-01084e7f2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f315d65-2ac2-4f6e-bb89-01084e7f2753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52102058-5573-4f43-bb70-21e692f278d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:04 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume e91c1353-9ba0-4354-a082-bcfa9732ec47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91c1353-9ba0-4354-a082-bcfa9732ec47', 'volume_size': 1}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922914041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91c1353-9ba0-4354-a082-bcfa9732ec47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:04Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Creating volume e91c1353-9ba0-4354-a082-bcfa9732ec47 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:04 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:04 devstack sudo[100888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47 1073741824
Sep 08 16:43:04 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:04 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66" returned: 0 in 0.440s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:04 devstack sudo[100897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66
Sep 08 16:43:04 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:04 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47 1073741824" returned: 0 in 0.501s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:04 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-801b1505-6a65-4d73-9f68-65293c95ef66" returned: 0 in 0.261s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Lock "cinder-quobyte-801b1505-6a65-4d73-9f68-65293c95ef66" released by "delete_volume" :: held 0.767s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:04 devstack sudo[100900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47
Sep 08 16:43:04 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:04 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Created reservations ['8c3b4313-5a6b-4cf8-af6e-ddd61279fbea'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:04 devstack cinder-volume[87505]: WARNING cinder.quota [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-4430546 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-4430546, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:43:04 devstack cinder-volume[87505]: WARNING cinder.quota [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-4430546 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-4430546, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Created reservations ['fb3940fe-6077-4035-82a1-a822c13278df', 'b8bc574a-a910-49a3-b0fd-ef0548cbdc4c', 'bc7986ba-1d8d-4eb2-94ac-586b573fc9bd', 'de81c20d-cf47-474f-bd15-c4a36b6d15c8'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:05 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47" returned: 0 in 0.297s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52102058-5573-4f43-bb70-21e692f278d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91c1353-9ba0-4354-a082-bcfa9732ec47', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb6c05f-eee6-4b8f-91e0-a88f9d0afb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:05 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume volume-e91c1353-9ba0-4354-a082-bcfa9732ec47 (e91c1353-9ba0-4354-a082-bcfa9732ec47): created successfully
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb6c05f-eee6-4b8f-91e0-a88f9d0afb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (e3112339-8405-43c4-9e2f-807ffa5d7e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-149175d6-96b8-43dc-8fd1-aad3739b39cf tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created volume successfully.
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Created reservations ['a73fe9e1-1e1b-4754-8170-c1afe7ead547', 'eac77a4e-b9cf-4a7d-8606-020d5d257b5a', 'e28072bf-7022-471d-b57a-5c834c21d295', '44964801-bdc8-4ed2-af2f-41ea68bdc9f3'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:05 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:05 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:05 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.273s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:05 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-014392f1-4b91-47dc-9979-0251ac6f2e17 tempest-GroupsTest-1872208960 None] Delete group completed successfully.
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (8c6954a8-bbab-4571-aa58-07e2fcf7c9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d50c80-8a4a-429c-a5a8-bc9cb4ff214b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d50c80-8a4a-429c-a5a8-bc9cb4ff214b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426326524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be93cae0-ff71-4f2f-a86c-acbe22317857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:07Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f77daf-36d2-4e00-ae69-6f52d024aaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f77daf-36d2-4e00-ae69-6f52d024aaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b068a7c-222d-4040-a330-751bf2883e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b068a7c-222d-4040-a330-751bf2883e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be93cae0-ff71-4f2f-a86c-acbe22317857', 'volume_name': 'volume-be93cae0-ff71-4f2f-a86c-acbe22317857', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef18cd84-e5a3-44c1-9f4e-ba4bc9229d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef18cd84-e5a3-44c1-9f4e-ba4bc9229d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819c9f0d-f062-4fda-87b5-7327b64b50f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:06 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume be93cae0-ff71-4f2f-a86c-acbe22317857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be93cae0-ff71-4f2f-a86c-acbe22317857', 'volume_size': 1}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426326524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be93cae0-ff71-4f2f-a86c-acbe22317857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:07Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Creating volume be93cae0-ff71-4f2f-a86c-acbe22317857 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:06 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:07 devstack sudo[100906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857 1073741824
Sep 08 16:43:07 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (fee9ea9a-9a8a-41a5-a5ad-7d02229c04a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8ccdef-0f1c-40e0-80d7-64b92a676e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8ccdef-0f1c-40e0-80d7-64b92a676e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-442951963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800a6111-ba6c-4d00-835f-357463f7fdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:07Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07942a-b6b3-4114-ad7f-9cbe2018135e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07942a-b6b3-4114-ad7f-9cbe2018135e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45293849-6c20-43ae-a391-d28bcf5766c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45293849-6c20-43ae-a391-d28bcf5766c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800a6111-ba6c-4d00-835f-357463f7fdce', 'volume_name': 'volume-800a6111-ba6c-4d00-835f-357463f7fdce', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d4bc0c-ea99-4b40-b64a-9397b2f47c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77d4bc0c-ea99-4b40-b64a-9397b2f47c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286d5368-9e91-46ca-9154-868fbd93cf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume 800a6111-ba6c-4d00-835f-357463f7fdce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800a6111-ba6c-4d00-835f-357463f7fdce', 'volume_size': 1}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:07 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857 1073741824" returned: 0 in 0.752s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:07 devstack sudo[100913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857
Sep 08 16:43:07 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:08 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (b2878f30-7230-4ce7-8a9a-327c2514353e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52fc6f-eec9-48ce-a438-5adb5728325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857" returned: 0 in 0.390s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-442951963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800a6111-ba6c-4d00-835f-357463f7fdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:07Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Creating volume 800a6111-ba6c-4d00-835f-357463f7fdce {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:08 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab52fc6f-eec9-48ce-a438-5adb5728325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26515191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd87601-093e-4fbd-a697-52bca3b27163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:08Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce 1073741824
Sep 08 16:43:08 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0136fd5b-f30a-49a3-8524-d8b89293a67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0136fd5b-f30a-49a3-8524-d8b89293a67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103b11fa-4c50-48f8-977b-8e199ca1ee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103b11fa-4c50-48f8-977b-8e199ca1ee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd87601-093e-4fbd-a697-52bca3b27163', 'volume_name': 'volume-3bd87601-093e-4fbd-a697-52bca3b27163', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2daacbce-b0ab-4276-b666-04c0586ea023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2daacbce-b0ab-4276-b666-04c0586ea023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0797899a-258f-42b8-9c65-f3ac755089ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume 3bd87601-093e-4fbd-a697-52bca3b27163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd87601-093e-4fbd-a697-52bca3b27163', 'volume_size': 1}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819c9f0d-f062-4fda-87b5-7327b64b50f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be93cae0-ff71-4f2f-a86c-acbe22317857', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31af10c2-1dcd-49a0-9251-3b147c5b170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume volume-be93cae0-ff71-4f2f-a86c-acbe22317857 (be93cae0-ff71-4f2f-a86c-acbe22317857): created successfully
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31af10c2-1dcd-49a0-9251-3b147c5b170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (8c6954a8-bbab-4571-aa58-07e2fcf7c9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:08 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9d80c9bc-38f1-4b16-840d-42a76f0b4585 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created volume successfully.
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (cdcd4ea2-fbca-4eab-8a0a-a52d1c47e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038bb9ec-f4a8-4f1b-9666-1ef84bdbde6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038bb9ec-f4a8-4f1b-9666-1ef84bdbde6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273628102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c105075-2b06-4428-9201-a91c341c48b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:09Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a3925c-9791-47e4-9bcd-21e5b1efa133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a3925c-9791-47e4-9bcd-21e5b1efa133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514a166c-7fdc-4ffa-a252-5b71b3683c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514a166c-7fdc-4ffa-a252-5b71b3683c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c105075-2b06-4428-9201-a91c341c48b4', 'volume_name': 'volume-7c105075-2b06-4428-9201-a91c341c48b4', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb78190f-171d-44ed-871f-792359df1110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb78190f-171d-44ed-871f-792359df1110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd9cd0-b18b-44b5-a2e8-a4504aa5dc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:08 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume 7c105075-2b06-4428-9201-a91c341c48b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c105075-2b06-4428-9201-a91c341c48b4', 'volume_size': 1}
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:08 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce 1073741824" returned: 0 in 0.777s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:09 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce
Sep 08 16:43:09 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (4ac8e9d4-708e-4d40-a505-e341f7a62ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234cdccb-e469-4cf0-8346-b85fb49375c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (234cdccb-e469-4cf0-8346-b85fb49375c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285599454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4028611-d303-4282-b619-29904b8c67e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:09Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6052ae22-0760-429b-8a9b-c8f7ccd1dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6052ae22-0760-429b-8a9b-c8f7ccd1dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff8dbf2-1817-4788-885d-1cd15d6c5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff8dbf2-1817-4788-885d-1cd15d6c5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4028611-d303-4282-b619-29904b8c67e3', 'volume_name': 'volume-e4028611-d303-4282-b619-29904b8c67e3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b7a1c3-a744-4d69-a6fa-341113345f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b7a1c3-a744-4d69-a6fa-341113345f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98432c35-7129-4c80-bef4-797762472108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:09 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume e4028611-d303-4282-b619-29904b8c67e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4028611-d303-4282-b619-29904b8c67e3', 'volume_size': 1}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:09 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce" returned: 0 in 0.372s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.099s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26515191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd87601-093e-4fbd-a697-52bca3b27163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:08Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Creating volume 3bd87601-093e-4fbd-a697-52bca3b27163 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:09 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286d5368-9e91-46ca-9154-868fbd93cf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800a6111-ba6c-4d00-835f-357463f7fdce', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdc0595-c460-41a8-9489-5cad7f6f3af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:09 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163 1073741824
Sep 08 16:43:09 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:09 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume volume-800a6111-ba6c-4d00-835f-357463f7fdce (800a6111-ba6c-4d00-835f-357463f7fdce): created successfully
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdc0595-c460-41a8-9489-5cad7f6f3af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (fee9ea9a-9a8a-41a5-a5ad-7d02229c04a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:09 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8a31f832-be8f-4c31-bdc1-17bf1c98f21b tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created volume successfully.
Sep 08 16:43:09 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163 1073741824" returned: 0 in 0.555s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:10 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163
Sep 08 16:43:10 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:10 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163" returned: 0 in 0.383s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273628102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c105075-2b06-4428-9201-a91c341c48b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:09Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Creating volume 7c105075-2b06-4428-9201-a91c341c48b4 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:10 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0797899a-258f-42b8-9c65-f3ac755089ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd87601-093e-4fbd-a697-52bca3b27163', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875ca467-68ae-4046-84d2-566c8b3adec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:10 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4 1073741824
Sep 08 16:43:10 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:10 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume volume-3bd87601-093e-4fbd-a697-52bca3b27163 (3bd87601-093e-4fbd-a697-52bca3b27163): created successfully
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875ca467-68ae-4046-84d2-566c8b3adec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (b2878f30-7230-4ce7-8a9a-327c2514353e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8a9a32f2-5008-4e61-8536-148da4c9bcac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created volume successfully.
Sep 08 16:43:10 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4 1073741824" returned: 0 in 0.525s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:10 devstack sudo[100946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4
Sep 08 16:43:10 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:11 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4" returned: 0 in 0.262s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285599454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4028611-d303-4282-b619-29904b8c67e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79140f9ac43e4a748f918c289be741ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:09Z,use_quota=True,user_id='0420f1c3a2ca441d886bbd8b7bdf0edb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Creating volume e4028611-d303-4282-b619-29904b8c67e3 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:11 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:11 devstack sudo[100949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3 1073741824
Sep 08 16:43:11 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cd9cd0-b18b-44b5-a2e8-a4504aa5dc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c105075-2b06-4428-9201-a91c341c48b4', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d944d45-9cb6-4e27-ba7b-21bf95193b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:11 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume volume-7c105075-2b06-4428-9201-a91c341c48b4 (7c105075-2b06-4428-9201-a91c341c48b4): created successfully
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d944d45-9cb6-4e27-ba7b-21bf95193b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (cdcd4ea2-fbca-4eab-8a0a-a52d1c47e500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:11 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-df6ecb60-6b2f-45a7-b236-353bc486ce3d tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created volume successfully.
Sep 08 16:43:11 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3 1073741824" returned: 0 in 0.547s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:11 devstack sudo[100955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3
Sep 08 16:43:11 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:12 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3" returned: 0 in 0.278s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98432c35-7129-4c80-bef4-797762472108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4028611-d303-4282-b619-29904b8c67e3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9b23df-2217-4de3-8d65-385d3a58e0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:12 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Volume volume-e4028611-d303-4282-b619-29904b8c67e3 (e4028611-d303-4282-b619-29904b8c67e3): created successfully
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9b23df-2217-4de3-8d65-385d3a58e0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Flow 'volume_create_manager' (4ac8e9d4-708e-4d40-a505-e341f7a62ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d3792897-44e1-4ebb-865f-64f659381383 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created volume successfully.
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-e4028611-d303-4282-b619-29904b8c67e3-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-e4028611-d303-4282-b619-29904b8c67e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-quobyte-e4028611-d303-4282-b619-29904b8c67e3" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-e4028611-d303-4282-b619-29904b8c67e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd42e3a1-943c-4c29-8a8e-ec8de6f281a0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:12 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3
Sep 08 16:43:12 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:13 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3" returned: 0 in 0.404s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:13 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3
Sep 08 16:43:13 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:13 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e4028611-d303-4282-b619-29904b8c67e3" returned: 0 in 0.267s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-e4028611-d303-4282-b619-29904b8c67e3" released by "delete_volume" :: held 0.725s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created reservations ['9af1dd21-1e76-43e4-8a49-0ddc0217622b', 'f3851582-e547-48ec-8ea1-e4637b3f5749', 'd4f1b62a-517d-4de6-9410-56e7689e0fdc', '2c28be58-3c5d-4e3e-90c6-f28c4a8a3cbc'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-7c105075-2b06-4428-9201-a91c341c48b4-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:13 devstack sudo[100967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:13 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-7c105075-2b06-4428-9201-a91c341c48b4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-quobyte-7c105075-2b06-4428-9201-a91c341c48b4" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-7c105075-2b06-4428-9201-a91c341c48b4" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b48f69c-57d1-46bb-9f36-b2bc42952564]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:14 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.280s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Deleted volume successfully.
Sep 08 16:43:14 devstack sudo[100969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4
Sep 08 16:43:14 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4316cb86-d681-4d1b-9f64-eb986eb68220 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-e4028611-d303-4282-b619-29904b8c67e3-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:14 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4" returned: 0 in 0.391s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:14 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4
Sep 08 16:43:14 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:14 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7c105075-2b06-4428-9201-a91c341c48b4" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-7c105075-2b06-4428-9201-a91c341c48b4" released by "delete_volume" :: held 0.711s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created reservations ['ac2a3c8a-7416-4faa-b9e1-2771cc71275c', '116fb353-acdc-4e34-ae3d-60de216ab1ed', 'e51ca42d-1c05-4149-8894-5e7018a04084', 'd2a56a2b-5d49-4eab-a509-366362479683'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:14 devstack sudo[100978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:14 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-3bd87601-093e-4fbd-a697-52bca3b27163-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-3bd87601-093e-4fbd-a697-52bca3b27163-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-quobyte-3bd87601-093e-4fbd-a697-52bca3b27163" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-3bd87601-093e-4fbd-a697-52bca3b27163" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a15557f-6707-4b64-bc40-783e49f56ac5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:15 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.357s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Deleted volume successfully.
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25d6ffd3-9f2e-4f13-baff-0c6e042ad304 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-7c105075-2b06-4428-9201-a91c341c48b4-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:15 devstack sudo[100981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163
Sep 08 16:43:15 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:15 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163" returned: 0 in 0.459s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:15 devstack sudo[100986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163
Sep 08 16:43:15 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:15 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-3bd87601-093e-4fbd-a697-52bca3b27163" returned: 0 in 0.277s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-3bd87601-093e-4fbd-a697-52bca3b27163" released by "delete_volume" :: held 0.778s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:15 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created reservations ['4eb251c5-a428-482b-9e81-6ed45bf184d8', 'd03c4dcc-ecd3-4e72-bae8-77bd9d00c068', '2da30baf-0b01-467d-ba58-c6d476a94a06', '43b5e972-3bbf-4f13-ac74-534eea93f077'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:16 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:16 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-800a6111-ba6c-4d00-835f-357463f7fdce-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-800a6111-ba6c-4d00-835f-357463f7fdce-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-quobyte-800a6111-ba6c-4d00-835f-357463f7fdce" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:16 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.256s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Deleted volume successfully.
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-800a6111-ba6c-4d00-835f-357463f7fdce" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1a7522-549a-444b-b192-1bca2cf2dd62]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-924e062c-ea79-475f-99af-665e7603ba6e tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-3bd87601-093e-4fbd-a697-52bca3b27163-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:16 devstack sudo[100992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce
Sep 08 16:43:16 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:16 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce" returned: 0 in 0.480s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:16 devstack sudo[100997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce
Sep 08 16:43:16 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:17 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-800a6111-ba6c-4d00-835f-357463f7fdce" returned: 0 in 0.277s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-800a6111-ba6c-4d00-835f-357463f7fdce" released by "delete_volume" :: held 0.811s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created reservations ['e4cd99d4-f507-4852-b26b-913aa0f770d8', '60b04457-197d-45ea-86bd-6869a4ecfdcc', '94d4ed57-5f76-4b1f-97eb-11fc92632b65', 'd8bc06ec-8693-4d18-9283-834844f8e688'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:17 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:17 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-be93cae0-ff71-4f2f-a86c-acbe22317857-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-be93cae0-ff71-4f2f-a86c-acbe22317857-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-quobyte-be93cae0-ff71-4f2f-a86c-acbe22317857" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-be93cae0-ff71-4f2f-a86c-acbe22317857" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa13ac-b519-47e9-8076-1ec155917c4e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:17 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.400s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Deleted volume successfully.
Sep 08 16:43:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5bfdc25e-a0d2-4c9f-a922-6ec0cce3b755 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-800a6111-ba6c-4d00-835f-357463f7fdce-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:17 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857
Sep 08 16:43:17 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:18 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857" returned: 0 in 0.470s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:18 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857
Sep 08 16:43:18 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:18 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-be93cae0-ff71-4f2f-a86c-acbe22317857" returned: 0 in 0.322s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-be93cae0-ff71-4f2f-a86c-acbe22317857" released by "delete_volume" :: held 0.844s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created reservations ['a4a8cd2d-e65d-44d5-8d80-b01c43d69313', '5778856e-bf55-413f-8bb8-5a07bf380c1b', '71c22a55-84bb-4fb9-be24-221f513d64db', '02f82691-5a04-4da5-b6f2-6dcd57c378b6'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:18 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:18 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-e91c1353-9ba0-4354-a082-bcfa9732ec47-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-e91c1353-9ba0-4354-a082-bcfa9732ec47-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "cinder-quobyte-e91c1353-9ba0-4354-a082-bcfa9732ec47" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-e91c1353-9ba0-4354-a082-bcfa9732ec47" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[739a2ede-8013-4e1d-b255-17a57c60e403]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:19 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.410s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Deleted volume successfully.
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2c18a95c-02d6-43cf-b1b2-690cefa6a2a1 tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-be93cae0-ff71-4f2f-a86c-acbe22317857-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:19 devstack sudo[101014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47
Sep 08 16:43:19 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:19 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47" returned: 0 in 0.434s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:19 devstack sudo[101019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47
Sep 08 16:43:19 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:19 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e91c1353-9ba0-4354-a082-bcfa9732ec47" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-quobyte-e91c1353-9ba0-4354-a082-bcfa9732ec47" released by "delete_volume" :: held 0.827s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Created reservations ['804437e4-38b9-4e05-adc3-2c5346852d0e', 'f94b8855-e567-432e-a03c-1c6f09050175', '699011f2-c445-49e2-9ebe-90120459e440', '606b60e5-0f8b-4ee5-b2b8-c823191843e2'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:20 devstack sudo[101022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:20 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:20 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.307s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:20 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Deleted volume successfully.
Sep 08 16:43:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d8b411bd-ed78-4b00-a54c-8a3c3d72afac tempest-CreateVolumesFromSourceVolumeTest-175654979 None] Lock "cinder-e91c1353-9ba0-4354-a082-bcfa9732ec47-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Flow 'volume_create_manager' (e32a7dfe-beb4-492c-828c-3ba4513fe034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b99451c-05b6-4ee0-8f7e-3b87ad2e4382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b99451c-05b6-4ee0-8f7e-3b87ad2e4382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1887546144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2169e11b-87d0-4233-91d3-cb4ac9c14dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff9c992b5264a08b683204dd5148071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:22Z,use_quota=True,user_id='bef5b64c2ce84d3fb7843107f8cf0bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2178b8a0-0971-497d-9478-45d08295b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2178b8a0-0971-497d-9478-45d08295b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2066596-7a22-4b0a-aa4a-188768057322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2066596-7a22-4b0a-aa4a-188768057322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2169e11b-87d0-4233-91d3-cb4ac9c14dc1', 'volume_name': 'volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c0467-b5a4-47de-b191-affb4c4a53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c0467-b5a4-47de-b191-affb4c4a53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc3071c-6aab-4456-b724-39f66c8adbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:22 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Volume 2169e11b-87d0-4233-91d3-cb4ac9c14dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1', 'volume_size': 1}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1887546144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2169e11b-87d0-4233-91d3-cb4ac9c14dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff9c992b5264a08b683204dd5148071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:22Z,use_quota=True,user_id='bef5b64c2ce84d3fb7843107f8cf0bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Creating volume 2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:22 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:22 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 1073741824
Sep 08 16:43:22 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:22 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 1073741824" returned: 0 in 0.570s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:22 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1
Sep 08 16:43:22 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:23 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" returned: 0 in 0.274s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc3071c-6aab-4456-b724-39f66c8adbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3605f71-94a1-45c9-aac2-0164f1c1e528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:23 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Volume volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 (2169e11b-87d0-4233-91d3-cb4ac9c14dc1): created successfully
Sep 08 16:43:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3605f71-94a1-45c9-aac2-0164f1c1e528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Flow 'volume_create_manager' (e32a7dfe-beb4-492c-828c-3ba4513fe034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8fbe215e-c5fb-4ff7-9fc4-f4e138baee81 tempest-SnapshotDependencyTests-1478835466 None] Created volume successfully.
Sep 08 16:43:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Creating offline snapshot 4197131d-95af-49d0-9e82-3ef838229238 of volume 2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:43:24 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f094d7-2d8c-4151-b984-c1b4e7dfbc0d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:24 devstack sudo[101035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1
Sep 08 16:43:24 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:24 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" returned: 0 in 0.408s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:25 devstack sudo[101040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 1G
Sep 08 16:43:25 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Flow 'volume_create_manager' (df0e83a3-b754-4464-8810-ff5e9bbb8d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d711a1-bd3d-4ede-b569-5125b760a1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:25 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 1G" returned: 0 in 0.512s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d711a1-bd3d-4ede-b569-5125b760a1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169624345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ac6a2d-4307-47ad-998b-e4d680625faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2ca8c80fcd42e196dce1b87d636ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:25Z,use_quota=True,user_id='5aa7a67d8c4945bd947e4aea4a2dfb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24eb5fab-cc44-4d09-b04f-3096d2d83f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:25 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238
Sep 08 16:43:25 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24eb5fab-cc44-4d09-b04f-3096d2d83f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d0eaec-a7cb-4997-a580-55a68180265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3d0eaec-a7cb-4997-a580-55a68180265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ac6a2d-4307-47ad-998b-e4d680625faa', 'volume_name': 'volume-13ac6a2d-4307-47ad-998b-e4d680625faa', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a5d5e8-623c-4419-b4c3-baf218313f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a5d5e8-623c-4419-b4c3-baf218313f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c048568-ada6-4025-847e-610d188f52a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:25 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Volume 13ac6a2d-4307-47ad-998b-e4d680625faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ac6a2d-4307-47ad-998b-e4d680625faa', 'volume_size': 1}
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:25 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238" returned: 0 in 0.350s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:25 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 is being set with open permissions: ugo+rw
Sep 08 16:43:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:25 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238
Sep 08 16:43:25 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:26 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238" returned: 0 in 0.285s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:26 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.info
Sep 08 16:43:26 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:26 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.info" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:26 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.info is being set with open permissions: ugo+rw
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:26 devstack sudo[101057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.info
Sep 08 16:43:26 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:26 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.info" returned: 0 in 0.270s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169624345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13ac6a2d-4307-47ad-998b-e4d680625faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2ca8c80fcd42e196dce1b87d636ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:25Z,use_quota=True,user_id='5aa7a67d8c4945bd947e4aea4a2dfb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Creating volume 13ac6a2d-4307-47ad-998b-e4d680625faa {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:26 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:26 devstack sudo[101060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa 1073741824
Sep 08 16:43:26 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9a188364-a3aa-4837-8dac-27180e621d4a tempest-SnapshotDependencyTests-1478835466 None] Create snapshot completed successfully
Sep 08 16:43:27 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa 1073741824" returned: 0 in 0.427s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:27 devstack sudo[101066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa
Sep 08 16:43:27 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:27 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa" returned: 0 in 0.265s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c048568-ada6-4025-847e-610d188f52a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ac6a2d-4307-47ad-998b-e4d680625faa', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266b7fed-dca8-47ab-b7fe-7ebe679d72ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:27 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Volume volume-13ac6a2d-4307-47ad-998b-e4d680625faa (13ac6a2d-4307-47ad-998b-e4d680625faa): created successfully
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (266b7fed-dca8-47ab-b7fe-7ebe679d72ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Flow 'volume_create_manager' (df0e83a3-b754-4464-8810-ff5e9bbb8d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e9e54499-c1e1-4ad1-a227-3bbc41201bc2 tempest-ProjectReaderTests-455665475 None] Created volume successfully.
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Flow 'volume_create_manager' (2a0c19af-7a6d-47f3-8d08-a8305ad9b084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b71963c-3769-43c4-a7fc-07336a956ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b71963c-3769-43c4-a7fc-07336a956ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2ae93e-63bb-4872-9b16-1683be3605c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff9c992b5264a08b683204dd5148071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4197131d-95af-49d0-9e82-3ef838229238,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:28Z,use_quota=True,user_id='bef5b64c2ce84d3fb7843107f8cf0bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3b1dd9-3757-4b71-9510-32b0d2c654bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3b1dd9-3757-4b71-9510-32b0d2c654bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46796e-5f48-4221-a8da-22e34fe7b1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec46796e-5f48-4221-a8da-22e34fe7b1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed2ae93e-63bb-4872-9b16-1683be3605c3', 'volume_name': 'volume-ed2ae93e-63bb-4872-9b16-1683be3605c3', 'volume_size': 1, 'snapshot_id': '4197131d-95af-49d0-9e82-3ef838229238'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb21099-eede-46c9-9190-4f4295549167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb21099-eede-46c9-9190-4f4295549167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57376cac-57d7-439b-9162-f4b5017a71c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:28 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Volume ed2ae93e-63bb-4872-9b16-1683be3605c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed2ae93e-63bb-4872-9b16-1683be3605c3', 'volume_size': 1, 'snapshot_id': '4197131d-95af-49d0-9e82-3ef838229238'}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-quobyte-4197131d-95af-49d0-9e82-3ef838229238-ed2ae93e-63bb-4872-9b16-1683be3605c3" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-4197131d-95af-49d0-9e82-3ef838229238-ed2ae93e-63bb-4872-9b16-1683be3605c3" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Creating volume ed2ae93e-63bb-4872-9b16-1683be3605c3 from snapshot 4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-quobyte-ed2ae93e-63bb-4872-9b16-1683be3605c3" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-ed2ae93e-63bb-4872-9b16-1683be3605c3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] snapshot: 4197131d-95af-49d0-9e82-3ef838229238, volume: ed2ae93e-63bb-4872-9b16-1683be3605c3,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b1bac5-8f54-457a-a564-dec98ce31830]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Acquiring lock "cinder-13ac6a2d-4307-47ad-998b-e4d680625faa-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Lock "cinder-13ac6a2d-4307-47ad-998b-e4d680625faa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:28 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238
Sep 08 16:43:28 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Acquiring lock "cinder-quobyte-13ac6a2d-4307-47ad-998b-e4d680625faa" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Lock "cinder-quobyte-13ac6a2d-4307-47ad-998b-e4d680625faa" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e84ab0b-9ed2-4616-96dc-c448e0b398aa]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:29 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa
Sep 08 16:43:29 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:29 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238" returned: 0 in 0.472s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53c4b48-d825-449a-b125-149d9521a1e0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:29 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1
Sep 08 16:43:29 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:29 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa" returned: 0 in 0.443s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:29 devstack sudo[101083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa
Sep 08 16:43:29 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:29 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" returned: 0 in 0.407s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:29 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3
Sep 08 16:43:29 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:29 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-13ac6a2d-4307-47ad-998b-e4d680625faa" returned: 0 in 0.276s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Lock "cinder-quobyte-13ac6a2d-4307-47ad-998b-e4d680625faa" released by "delete_volume" :: held 0.767s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Created reservations ['16176997-9058-43e5-8e34-cb6032a0eb37', '0e97e23f-52e9-4dcd-b4a7-8944a3778e05', '9ce70797-ead7-47f1-af09-5d3db7bb1a77', '56d4ba43-d609-4008-b517-6462be91006a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:29 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:29 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:30 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.291s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:30 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Deleted volume successfully.
Sep 08 16:43:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0806b781-e39b-4a2f-9dc7-002ce738c002 tempest-ProjectReaderTests-455665475 None] Lock "cinder-13ac6a2d-4307-47ad-998b-e4d680625faa-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Flow 'volume_create_manager' (b4c4674a-86dc-4c3c-b36e-fae9f184c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431fd1b9-2cab-4f33-898a-97c422ce11e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431fd1b9-2cab-4f33-898a-97c422ce11e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397119439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4954415-99e1-4034-ae27-5f8488f4a173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2ca8c80fcd42e196dce1b87d636ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:31Z,use_quota=True,user_id='5aa7a67d8c4945bd947e4aea4a2dfb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081f3910-872f-4dd8-9605-b94839e6561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081f3910-872f-4dd8-9605-b94839e6561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d14ad4-44f8-4c8e-84b1-ac97691a1184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d14ad4-44f8-4c8e-84b1-ac97691a1184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4954415-99e1-4034-ae27-5f8488f4a173', 'volume_name': 'volume-c4954415-99e1-4034-ae27-5f8488f4a173', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f58021-9a20-4e54-bbfb-2f7cc7424b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f58021-9a20-4e54-bbfb-2f7cc7424b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c7b940-c960-4915-9d49-8dac52383f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:31 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Volume c4954415-99e1-4034-ae27-5f8488f4a173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4954415-99e1-4034-ae27-5f8488f4a173', 'volume_size': 1}
Sep 08 16:43:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:34 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3" returned: 0 in 4.771s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1, size 1024.00 MB, duration 4.77 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:43:34 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Converted 1024.00 MB image at 214.61 MB/s
Sep 08 16:43:34 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 is being set with open permissions: ugo+rw
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:34 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3
Sep 08 16:43:34 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:34 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-ed2ae93e-63bb-4872-9b16-1683be3605c3" released by "_copy_volume_from_snapshot" :: held 6.004s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-4197131d-95af-49d0-9e82-3ef838229238-ed2ae93e-63bb-4872-9b16-1683be3605c3" released by "_create_volume_from_snapshot" :: held 6.069s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.087s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.261s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-397119439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4954415-99e1-4034-ae27-5f8488f4a173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2ca8c80fcd42e196dce1b87d636ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:31Z,use_quota=True,user_id='5aa7a67d8c4945bd947e4aea4a2dfb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Creating volume c4954415-99e1-4034-ae27-5f8488f4a173 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:34 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:34 devstack sudo[101111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173 1073741824
Sep 08 16:43:34 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57376cac-57d7-439b-9162-f4b5017a71c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2ae93e-63bb-4872-9b16-1683be3605c3', 'volume_size': 1, 'snapshot_id': '4197131d-95af-49d0-9e82-3ef838229238'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7e366f-ab8d-46fa-98e8-20bf1a1870a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Volume volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 (ed2ae93e-63bb-4872-9b16-1683be3605c3): created successfully
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a7e366f-ab8d-46fa-98e8-20bf1a1870a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Flow 'volume_create_manager' (2a0c19af-7a6d-47f3-8d08-a8305ad9b084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6c7249dc-9e3f-40d1-8ffa-f72c76a74c80 tempest-SnapshotDependencyTests-1478835466 None] Created volume successfully.
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Flow 'volume_create_manager' (26784d8d-d7f5-45da-91b2-e78224815192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99467a4b-e569-49b0-b5a0-2bb46e96dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99467a4b-e569-49b0-b5a0-2bb46e96dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1022119701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8186cdd7-1d8d-4db8-aa4d-18f1f41c0494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d6e35fc68c4964b600de321f6e5cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:35Z,use_quota=True,user_id='db69772ea1b84a9a97e023d87603f720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ce8e90-68c7-464e-a209-56450f251dcc),volume_type_id=b4ce8e90-68c7-464e-a209-56450f251dcc)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d057103e-c8c1-4974-a7c1-c2dd1d30595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d057103e-c8c1-4974-a7c1-c2dd1d30595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8568507d-ec85-4a21-9659-89c17bfa465c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8568507d-ec85-4a21-9659-89c17bfa465c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8186cdd7-1d8d-4db8-aa4d-18f1f41c0494', 'volume_name': 'volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c698c0-9b19-47a5-8b86-82fd7f4af22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c698c0-9b19-47a5-8b86-82fd7f4af22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e632f8-b705-4d97-af47-d9a63dfdb5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Volume 8186cdd7-1d8d-4db8-aa4d-18f1f41c0494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494', 'volume_size': 1}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-4197131d-95af-49d0-9e82-3ef838229238-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-4197131d-95af-49d0-9e82-3ef838229238-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-quobyte-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-quobyte-4197131d-95af-49d0-9e82-3ef838229238" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-4197131d-95af-49d0-9e82-3ef838229238" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Deleting offline snapshot 4197131d-95af-49d0-9e82-3ef838229238 of volume 2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:43:35 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] snapshot_file for this snap is: volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173 1073741824" returned: 0 in 0.527s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c47999-a18d-4b2c-a653-156c17c8ff94]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:35 devstack sudo[101118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173
Sep 08 16:43:35 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:35 devstack sudo[101117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238
Sep 08 16:43:35 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:35 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1022119701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8186cdd7-1d8d-4db8-aa4d-18f1f41c0494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06d6e35fc68c4964b600de321f6e5cd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:35Z,use_quota=True,user_id='db69772ea1b84a9a97e023d87603f720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4ce8e90-68c7-464e-a209-56450f251dcc),volume_type_id=b4ce8e90-68c7-464e-a209-56450f251dcc)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Creating volume 8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:35 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:35 devstack sudo[101122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 1073741824
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c7b940-c960-4915-9d49-8dac52383f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4954415-99e1-4034-ae27-5f8488f4a173', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:35 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fa002d-9176-4d62-b49c-66c6b2d377b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Volume volume-c4954415-99e1-4034-ae27-5f8488f4a173 (c4954415-99e1-4034-ae27-5f8488f4a173): created successfully
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fa002d-9176-4d62-b49c-66c6b2d377b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Flow 'volume_create_manager' (b4c4674a-86dc-4c3c-b36e-fae9f184c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1bd0869a-c22e-401c-8cba-e75eaa2b2555 tempest-ProjectReaderTests-455665475 None] Created volume successfully.
Sep 08 16:43:35 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238" returned: 0 in 0.393s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6a768d-c02a-4a25-8647-48321faa29eb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:35 devstack sudo[101127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1
Sep 08 16:43:35 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:35 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 1073741824" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:36 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494
Sep 08 16:43:36 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:36 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:36 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" returned: 0 in 0.585s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494" returned: 0 in 0.258s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:36 devstack sudo[101138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e632f8-b705-4d97-af47-d9a63dfdb5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:36 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5521f0-73e5-46e3-b0d7-018ac6820238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Acquiring lock "cinder-c4954415-99e1-4034-ae27-5f8488f4a173-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:36 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Volume volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 (8186cdd7-1d8d-4db8-aa4d-18f1f41c0494): created successfully
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5521f0-73e5-46e3-b0d7-018ac6820238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Flow 'volume_create_manager' (26784d8d-d7f5-45da-91b2-e78224815192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Lock "cinder-c4954415-99e1-4034-ae27-5f8488f4a173-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4613b85c-bd76-47c8-9691-343d972a91dd tempest-VolumeTypesAccessTest-1919519396 None] Created volume successfully.
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Acquiring lock "cinder-quobyte-c4954415-99e1-4034-ae27-5f8488f4a173" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Lock "cinder-quobyte-c4954415-99e1-4034-ae27-5f8488f4a173" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdfb55e-f30b-4d3f-a874-43dd29358aa9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:36 devstack sudo[101140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173
Sep 08 16:43:36 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:36 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:36 devstack sudo[101145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238
Sep 08 16:43:36 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:36 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:36 devstack sudo[101150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173
Sep 08 16:43:36 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:36 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1.4197131d-95af-49d0-9e82-3ef838229238" returned: 0 in 0.251s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-4197131d-95af-49d0-9e82-3ef838229238" released by "_delete_snapshot" :: held 1.671s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" released by "delete_snapshot" :: held 1.701s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Created reservations ['a7e74494-91f1-42a8-b047-2830ff2fd361', '04a8e4a6-8382-402e-aa41-5929099398ca', 'ddecbf56-2ea8-4219-bce8-6a2724573a6c', '4932cfc7-387e-47ab-bae9-b73d4382cc59'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:36 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c4954415-99e1-4034-ae27-5f8488f4a173" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Lock "cinder-quobyte-c4954415-99e1-4034-ae27-5f8488f4a173" released by "delete_volume" :: held 0.622s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Delete snapshot completed successfully.
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-44979c48-8b40-4a1f-a3c3-9469058a8dc0 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-4197131d-95af-49d0-9e82-3ef838229238-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Created reservations ['dc50546a-e6eb-4c2c-be43-02d3bd7076ce', 'bd4d41b1-73f6-4957-ad04-c6cfaead03a1', '91029f83-8acc-4d1e-a63e-b7aef9cda3d5', '1663df75-6e4e-4019-a1e7-ac86d32a3f90'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:37 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:37 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Acquiring lock "cinder-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Lock "cinder-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Acquiring lock "cinder-quobyte-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Lock "cinder-quobyte-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f45f6e-7193-4e26-bf87-d116ee600486]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-2169e11b-87d0-4233-91d3-cb4ac9c14dc1-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-2169e11b-87d0-4233-91d3-cb4ac9c14dc1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:37 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.306s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-quobyte-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Deleted volume successfully.
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:37 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494
Sep 08 16:43:37 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d77bbf7d-1d3b-466f-9941-c4a4b5ece45b tempest-ProjectReaderTests-455665475 None] Lock "cinder-c4954415-99e1-4034-ae27-5f8488f4a173-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cce2a7-3047-4ae8-9d09-e965e005c40f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:37 devstack sudo[101159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1
Sep 08 16:43:37 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:37 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494" returned: 0 in 0.441s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:37 devstack sudo[101164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494
Sep 08 16:43:37 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:37 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" returned: 0 in 0.416s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:37 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1
Sep 08 16:43:37 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:38 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494" returned: 0 in 0.282s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Lock "cinder-quobyte-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494" released by "delete_volume" :: held 0.765s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:38 devstack cinder-volume[87505]: WARNING cinder.quota [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2135344744 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2135344744, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:43:38 devstack cinder-volume[87505]: WARNING cinder.quota [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2135344744 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2135344744, it is now deprecated. Please use the default quota class for default quota.
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Created reservations ['56d2968e-951b-42de-9e3b-4315ab5aa419', '83a8a8a7-5a8d-4da2-b66d-722ef432b909', '8818a133-ba33-4c4c-b663-b85ab460c259', 'fc7d3135-5857-4e7f-b34e-e2599333b189'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:38 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:38 devstack sudo[101173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:38 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-2169e11b-87d0-4233-91d3-cb4ac9c14dc1" released by "delete_volume" :: held 0.768s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Created reservations ['0165f0b3-e233-4179-ba9b-7c3cf879edab', 'e5d0e5d6-73c6-48be-ab4a-01bffc551984', 'ee229a96-ad8e-484c-895d-7e1e9e59df91', '2bb34140-dcd1-439a-aa16-9a7521a40048'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:38 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:38 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:38 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Deleted volume successfully.
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da71f80-2daf-41c0-88c8-0c02b1c0eff1 tempest-VolumeTypesAccessTest-1919519396 None] Lock "cinder-8186cdd7-1d8d-4db8-aa4d-18f1f41c0494-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-ed2ae93e-63bb-4872-9b16-1683be3605c3-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-ed2ae93e-63bb-4872-9b16-1683be3605c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "cinder-quobyte-ed2ae93e-63bb-4872-9b16-1683be3605c3" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-ed2ae93e-63bb-4872-9b16-1683be3605c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41375f1-4069-4aca-bff8-14db920bc522]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:38 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.454s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Deleted volume successfully.
Sep 08 16:43:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-fb917f82-37ec-4ab4-bd90-be5c4f732a2d tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-2169e11b-87d0-4233-91d3-cb4ac9c14dc1-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:38 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3
Sep 08 16:43:38 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:39 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:39 devstack sudo[101184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3
Sep 08 16:43:39 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:39 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ed2ae93e-63bb-4872-9b16-1683be3605c3" returned: 0 in 0.300s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-quobyte-ed2ae93e-63bb-4872-9b16-1683be3605c3" released by "delete_volume" :: held 0.779s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Created reservations ['0cfdba92-4974-4d1f-8b4e-0a9fab70a685', '11f6391f-80c1-4e43-bbf7-29bcff39061f', 'b408ca4c-1e5e-471e-9e2f-60a7773b5f69', 'd6734f50-1851-48ab-9396-cd57ccaa00bd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:39 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:39 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:40 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.328s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:40 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Deleted volume successfully.
Sep 08 16:43:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2253a29e-8df5-4583-b06b-9faaa0849e13 tempest-SnapshotDependencyTests-1478835466 None] Lock "cinder-ed2ae93e-63bb-4872-9b16-1683be3605c3-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=141,cinder:UPDATE=187,cinder:INSERT=50,cinder:DELETE=18 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=141,cinder:UPDATE=197,cinder:INSERT=45,cinder:DELETE=11 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Flow 'volume_create_manager' (df451156-b233-4836-9219-8ed67fdcf27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f20eab-e402-468e-ae46-361c2692a5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f20eab-e402-468e-ae46-361c2692a5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-49898162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f31312-0cc6-40ee-920b-e53bc8af0541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68b51233b0743edb1a718eabc56ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:47Z,use_quota=True,user_id='21f8974df2354af19058fabc443822f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd824418-5749-4526-88b7-c26e161776ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd824418-5749-4526-88b7-c26e161776ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfede57-7674-4096-8898-0ac4a50b9be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdfede57-7674-4096-8898-0ac4a50b9be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f31312-0cc6-40ee-920b-e53bc8af0541', 'volume_name': 'volume-c0f31312-0cc6-40ee-920b-e53bc8af0541', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4fc757-aad1-4ede-a877-8b645f4c8511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af4fc757-aad1-4ede-a877-8b645f4c8511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0c19ba-65b8-403a-bc58-d2731c737601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:47 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Volume c0f31312-0cc6-40ee-920b-e53bc8af0541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f31312-0cc6-40ee-920b-e53bc8af0541', 'volume_size': 1}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-49898162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f31312-0cc6-40ee-920b-e53bc8af0541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68b51233b0743edb1a718eabc56ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:47Z,use_quota=True,user_id='21f8974df2354af19058fabc443822f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Creating volume c0f31312-0cc6-40ee-920b-e53bc8af0541 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:47 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:47 devstack sudo[101195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541 1073741824
Sep 08 16:43:47 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:48 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541 1073741824" returned: 0 in 0.474s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:48 devstack sudo[101201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541
Sep 08 16:43:48 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (26369612-79c1-4cdb-81ff-677c038d46e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d47a1-6c8d-4a6d-8c3b-45128766a263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d47a1-6c8d-4a6d-8c3b-45128766a263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111322868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b315c0-b4e1-4dd0-9632-7ae370423334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:48Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65837d8c-9764-4c66-9f7e-2b12bf3eb3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65837d8c-9764-4c66-9f7e-2b12bf3eb3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419e358c-b3b5-4a74-a24d-acfc774f77e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419e358c-b3b5-4a74-a24d-acfc774f77e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b315c0-b4e1-4dd0-9632-7ae370423334', 'volume_name': 'volume-31b315c0-b4e1-4dd0-9632-7ae370423334', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f1a97-b0d8-4d65-959f-0108b4bc8db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f1a97-b0d8-4d65-959f-0108b4bc8db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd3bae-69ef-4002-b672-0808b513c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Volume 31b315c0-b4e1-4dd0-9632-7ae370423334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b315c0-b4e1-4dd0-9632-7ae370423334', 'volume_size': 1}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:48 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541" returned: 0 in 0.285s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2111322868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b315c0-b4e1-4dd0-9632-7ae370423334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:48Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Creating volume 31b315c0-b4e1-4dd0-9632-7ae370423334 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:48 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:48 devstack sudo[101204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334 1073741824
Sep 08 16:43:48 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0c19ba-65b8-403a-bc58-d2731c737601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f31312-0cc6-40ee-920b-e53bc8af0541', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1b3096-3ada-43f3-b148-e1f9ce5bdf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Volume volume-c0f31312-0cc6-40ee-920b-e53bc8af0541 (c0f31312-0cc6-40ee-920b-e53bc8af0541): created successfully
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b1b3096-3ada-43f3-b148-e1f9ce5bdf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Flow 'volume_create_manager' (df451156-b233-4836-9219-8ed67fdcf27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-00991da9-246e-4373-833a-31c1538686f5 tempest-VolumesListAdminTestJSON-576950517 None] Created volume successfully.
Sep 08 16:43:48 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334 1073741824" returned: 0 in 0.483s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:49 devstack sudo[101210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334
Sep 08 16:43:49 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:49 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334" returned: 0 in 0.276s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd3bae-69ef-4002-b672-0808b513c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b315c0-b4e1-4dd0-9632-7ae370423334', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e01af50-650e-450d-babb-4889a567ca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Volume volume-31b315c0-b4e1-4dd0-9632-7ae370423334 (31b315c0-b4e1-4dd0-9632-7ae370423334): created successfully
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e01af50-650e-450d-babb-4889a567ca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (26369612-79c1-4cdb-81ff-677c038d46e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b0a14bad-a9d4-48dd-a91b-e681cd1ea6e0 tempest-ProjectReaderTests-1863064615 None] Created volume successfully.
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Flow 'volume_create_manager' (1f82d43a-cac7-47a5-bf83-a847dc65aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac439a41-c33e-4dca-bd42-0178540705ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac439a41-c33e-4dca-bd42-0178540705ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959664099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e389c3c-196d-4f30-b1be-967051af199b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68b51233b0743edb1a718eabc56ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:50Z,use_quota=True,user_id='21f8974df2354af19058fabc443822f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d400b9-2eb3-4d4c-b1d1-34a29a8c8021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d400b9-2eb3-4d4c-b1d1-34a29a8c8021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc162b5-6781-4602-b240-0b0f335b1052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc162b5-6781-4602-b240-0b0f335b1052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e389c3c-196d-4f30-b1be-967051af199b', 'volume_name': 'volume-2e389c3c-196d-4f30-b1be-967051af199b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d857abe-76f6-40ac-a2bc-c97464ce69d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d857abe-76f6-40ac-a2bc-c97464ce69d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cb9408-2a35-430f-bb0a-fbf827613e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:50 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Volume 2e389c3c-196d-4f30-b1be-967051af199b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e389c3c-196d-4f30-b1be-967051af199b', 'volume_size': 1}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959664099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e389c3c-196d-4f30-b1be-967051af199b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68b51233b0743edb1a718eabc56ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:50Z,use_quota=True,user_id='21f8974df2354af19058fabc443822f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Creating volume 2e389c3c-196d-4f30-b1be-967051af199b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:50 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:50 devstack sudo[101214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b 1073741824
Sep 08 16:43:50 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-31b315c0-b4e1-4dd0-9632-7ae370423334-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Lock "cinder-31b315c0-b4e1-4dd0-9632-7ae370423334-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-quobyte-31b315c0-b4e1-4dd0-9632-7ae370423334" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:50 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b 1073741824" returned: 0 in 0.555s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-31b315c0-b4e1-4dd0-9632-7ae370423334" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e49507-b991-4c1f-97b6-51f8e0bfd8ca]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:50 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b
Sep 08 16:43:50 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:50 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334
Sep 08 16:43:50 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:51 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b" returned: 0 in 0.273s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5cb9408-2a35-430f-bb0a-fbf827613e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e389c3c-196d-4f30-b1be-967051af199b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a4d304-47b8-456e-a00c-8d073fc31b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:51 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Volume volume-2e389c3c-196d-4f30-b1be-967051af199b (2e389c3c-196d-4f30-b1be-967051af199b): created successfully
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a4d304-47b8-456e-a00c-8d073fc31b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Flow 'volume_create_manager' (1f82d43a-cac7-47a5-bf83-a847dc65aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-83ac89cf-69ee-4929-b05b-5ce08ed47b9e tempest-VolumesListAdminTestJSON-576950517 None] Created volume successfully.
Sep 08 16:43:51 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334" returned: 0 in 0.423s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:51 devstack sudo[101228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334
Sep 08 16:43:51 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:51 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-31b315c0-b4e1-4dd0-9632-7ae370423334" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-31b315c0-b4e1-4dd0-9632-7ae370423334" released by "delete_volume" :: held 0.712s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Created reservations ['e39f1466-8502-4a96-ad11-995f265dff65', 'bbf2b023-3616-4256-a948-85317ffeff2e', 'ad17df10-9c84-4314-a5c4-f829085f5eb9', '3dff5844-3ca7-4e30-b420-2505227f0ea6'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:51 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:51 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:51 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Deleted volume successfully.
Sep 08 16:43:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-943fea01-3b74-4798-b7e5-717aa5fc85ff tempest-ProjectReaderTests-1863064615 None] Lock "cinder-31b315c0-b4e1-4dd0-9632-7ae370423334-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (0cd3f14a-1cd8-4012-bd39-0e7d042bc7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84a60a-6c6b-4170-8db9-6db1e5999fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a84a60a-6c6b-4170-8db9-6db1e5999fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921947288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8afe78c-736c-4bb5-afe6-fc58d1156859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:52Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d542f278-4492-4bf8-8b22-68df6818ecb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d542f278-4492-4bf8-8b22-68df6818ecb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bb26d8-71e8-4244-8d68-9eaf9a9e588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bb26d8-71e8-4244-8d68-9eaf9a9e588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8afe78c-736c-4bb5-afe6-fc58d1156859', 'volume_name': 'volume-e8afe78c-736c-4bb5-afe6-fc58d1156859', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f5945e-2b65-463a-8a29-4b3b1db6c859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f5945e-2b65-463a-8a29-4b3b1db6c859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00744de9-8405-49ae-89ea-3a1cba737bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Volume e8afe78c-736c-4bb5-afe6-fc58d1156859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8afe78c-736c-4bb5-afe6-fc58d1156859', 'volume_size': 1}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-921947288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8afe78c-736c-4bb5-afe6-fc58d1156859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:52Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Creating volume e8afe78c-736c-4bb5-afe6-fc58d1156859 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:52 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:52 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859 1073741824
Sep 08 16:43:52 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Flow 'volume_create_manager' (201a5cc2-23a1-48d5-bdd0-b8bd47db196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403bd26f-c36b-4f51-bde0-3c593d7b0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403bd26f-c36b-4f51-bde0-3c593d7b0176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-830159911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68b51233b0743edb1a718eabc56ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:53Z,use_quota=True,user_id='21f8974df2354af19058fabc443822f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eccfbb-6d65-4c34-a492-cfb075e54351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eccfbb-6d65-4c34-a492-cfb075e54351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22433b7-45f9-4899-8bae-785375f450de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22433b7-45f9-4899-8bae-785375f450de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e', 'volume_name': 'volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf67f3-a0ab-4288-ad59-eb8b1755d75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf67f3-a0ab-4288-ad59-eb8b1755d75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daa4a8e-8e01-42f5-962d-ab5bb51b6476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Volume 56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e', 'volume_size': 1}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:52 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859 1073741824" returned: 0 in 0.450s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:52 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859
Sep 08 16:43:52 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:53 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859" returned: 0 in 0.241s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-830159911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b68b51233b0743edb1a718eabc56ff51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:53Z,use_quota=True,user_id='21f8974df2354af19058fabc443822f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Creating volume 56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:53 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00744de9-8405-49ae-89ea-3a1cba737bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8afe78c-736c-4bb5-afe6-fc58d1156859', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a8efd9-4ad0-4e6d-accc-33b846feddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:53 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e 1073741824
Sep 08 16:43:53 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Volume volume-e8afe78c-736c-4bb5-afe6-fc58d1156859 (e8afe78c-736c-4bb5-afe6-fc58d1156859): created successfully
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a8efd9-4ad0-4e6d-accc-33b846feddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (0cd3f14a-1cd8-4012-bd39-0e7d042bc7b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c15392b4-2eb7-44a1-a262-cb91f0350083 tempest-ProjectReaderTests-1863064615 None] Created volume successfully.
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-e8afe78c-736c-4bb5-afe6-fc58d1156859-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-e8afe78c-736c-4bb5-afe6-fc58d1156859-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-quobyte-e8afe78c-736c-4bb5-afe6-fc58d1156859" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-e8afe78c-736c-4bb5-afe6-fc58d1156859" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e43ac8-e5c6-406f-9fcc-3e5e27804c00]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:53 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e 1073741824" returned: 0 in 0.433s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:53 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859
Sep 08 16:43:53 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:53 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e
Sep 08 16:43:53 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:53 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859" returned: 0 in 0.375s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:53 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:53 devstack sudo[101258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859
Sep 08 16:43:53 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4daa4a8e-8e01-42f5-962d-ab5bb51b6476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f081971a-4c48-45dd-80f0-65284d2f7de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Volume volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e (56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e): created successfully
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f081971a-4c48-45dd-80f0-65284d2f7de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Flow 'volume_create_manager' (201a5cc2-23a1-48d5-bdd0-b8bd47db196a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-75c60077-a333-4653-8511-cb141e97b4b5 tempest-VolumesListAdminTestJSON-576950517 None] Created volume successfully.
Sep 08 16:43:53 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e8afe78c-736c-4bb5-afe6-fc58d1156859" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-e8afe78c-736c-4bb5-afe6-fc58d1156859" released by "delete_volume" :: held 0.644s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Created reservations ['48da5c5e-1698-4126-b477-503c289e71be', '7a004858-c67a-4770-8f89-694110d9f844', '75527b8b-e6cf-4bf3-8402-e50b8794a33b', '1ac114fc-3056-40d5-bae3-9e4160e152bd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:54 devstack sudo[101261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:54 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:54 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.234s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Deleted volume successfully.
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-81819573-ee7e-4e26-82c8-809581c66907 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-e8afe78c-736c-4bb5-afe6-fc58d1156859-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (b294e2f2-8678-4d9b-82af-9e8032333bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44252a5-8c53-4804-846f-cd80793761c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44252a5-8c53-4804-846f-cd80793761c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929145356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73c96bd-3927-449f-88fa-08717f3361d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:55Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c604cf-f115-40e8-815c-b7972facaee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c604cf-f115-40e8-815c-b7972facaee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec89d02d-a191-4247-8327-4f7e128987b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec89d02d-a191-4247-8327-4f7e128987b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73c96bd-3927-449f-88fa-08717f3361d6', 'volume_name': 'volume-d73c96bd-3927-449f-88fa-08717f3361d6', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d804ac9-1b73-4454-899f-06e924e973aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d804ac9-1b73-4454-899f-06e924e973aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cf2105-42d9-417a-826a-df7c886afd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Volume d73c96bd-3927-449f-88fa-08717f3361d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73c96bd-3927-449f-88fa-08717f3361d6', 'volume_size': 1}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929145356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73c96bd-3927-449f-88fa-08717f3361d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:55Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Creating volume d73c96bd-3927-449f-88fa-08717f3361d6 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:55 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:55 devstack sudo[101264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6 1073741824
Sep 08 16:43:55 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:55 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6 1073741824" returned: 0 in 0.518s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:55 devstack sudo[101304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6
Sep 08 16:43:55 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Flow 'volume_create_manager' (46b3638f-465f-4973-a840-457f68bf95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0502a9-1eaf-4d17-8bce-ca915ae11210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0502a9-1eaf-4d17-8bce-ca915ae11210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571f77a0-374b-4d93-8416-e73ea8908ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c7ce2d91c4ce08bd387990392b2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:56Z,use_quota=True,user_id='1a5405f1ade549c2a2eb88992288cd8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3198ff1-8a81-4cf1-8d0b-72bdc8af6376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3198ff1-8a81-4cf1-8d0b-72bdc8af6376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28280047-18f2-4239-a755-12ca7c5eb7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28280047-18f2-4239-a755-12ca7c5eb7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571f77a0-374b-4d93-8416-e73ea8908ea5', 'volume_name': 'volume-571f77a0-374b-4d93-8416-e73ea8908ea5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da00f47b-938a-466a-ae32-243eaf65487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da00f47b-938a-466a-ae32-243eaf65487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4188be13-1ee7-48a2-9c4a-64fd3ac42507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Volume 571f77a0-374b-4d93-8416-e73ea8908ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571f77a0-374b-4d93-8416-e73ea8908ea5', 'volume_size': 1}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:55 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6" returned: 0 in 0.241s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571f77a0-374b-4d93-8416-e73ea8908ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb0c7ce2d91c4ce08bd387990392b2a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:56Z,use_quota=True,user_id='1a5405f1ade549c2a2eb88992288cd8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Creating volume 571f77a0-374b-4d93-8416-e73ea8908ea5 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:55 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42cf2105-42d9-417a-826a-df7c886afd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73c96bd-3927-449f-88fa-08717f3361d6', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack sudo[101309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5 1073741824
Sep 08 16:43:55 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118cdd3c-9e13-4126-91c4-9b0260a4f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Volume volume-d73c96bd-3927-449f-88fa-08717f3361d6 (d73c96bd-3927-449f-88fa-08717f3361d6): created successfully
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118cdd3c-9e13-4126-91c4-9b0260a4f862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (b294e2f2-8678-4d9b-82af-9e8032333bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:55 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d452a287-92b3-427b-b828-c61059f3152e tempest-ProjectReaderTests-1863064615 None] Created volume successfully.
Sep 08 16:43:56 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5 1073741824" returned: 0 in 0.380s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:56 devstack sudo[101314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5
Sep 08 16:43:56 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:56 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4188be13-1ee7-48a2-9c4a-64fd3ac42507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571f77a0-374b-4d93-8416-e73ea8908ea5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04baaec2-d437-4d36-bf43-6fdb629c0585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:56 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Volume volume-571f77a0-374b-4d93-8416-e73ea8908ea5 (571f77a0-374b-4d93-8416-e73ea8908ea5): created successfully
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04baaec2-d437-4d36-bf43-6fdb629c0585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Flow 'volume_create_manager' (46b3638f-465f-4973-a840-457f68bf95ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-71b77ea0-f157-4fc2-bf8f-5ad4f4410bf6 tempest-VolumesListAdminTestJSON-1622244 None] Created volume successfully.
Sep 08 16:43:56 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:56 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:56 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:43:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-d73c96bd-3927-449f-88fa-08717f3361d6-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Lock "cinder-d73c96bd-3927-449f-88fa-08717f3361d6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-quobyte-d73c96bd-3927-449f-88fa-08717f3361d6" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-d73c96bd-3927-449f-88fa-08717f3361d6" acquired by "delete_volume" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5c537d-39cd-4e30-89b9-5823c034f381]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:57 devstack sudo[101320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6
Sep 08 16:43:57 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:57 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6" returned: 0 in 0.335s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:57 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6
Sep 08 16:43:57 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:57 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d73c96bd-3927-449f-88fa-08717f3361d6" returned: 0 in 0.272s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Acquiring lock "cinder-571f77a0-374b-4d93-8416-e73ea8908ea5-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-d73c96bd-3927-449f-88fa-08717f3361d6" released by "delete_volume" :: held 0.655s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Lock "cinder-571f77a0-374b-4d93-8416-e73ea8908ea5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Acquiring lock "cinder-quobyte-571f77a0-374b-4d93-8416-e73ea8908ea5" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Lock "cinder-quobyte-571f77a0-374b-4d93-8416-e73ea8908ea5" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Created reservations ['7bdc14fa-acbb-4fa5-9ccc-d277fc5c408e', '9869a9eb-6176-4575-a631-cdaec1d06caa', '9b5f3355-e20f-4144-a042-b47000d1181e', 'd2f86cfe-36f6-4674-ad4e-e038760c55af'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ed9ef9-b3fb-4db4-859c-f3aecb799f74]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "cinder-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "cinder-quobyte-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:58 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5
Sep 08 16:43:58 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:58 devstack sudo[101329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-quobyte-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e" acquired by "delete_volume" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:58 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb1d52f-6520-4e24-884d-c6a7d26266b5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:58 devstack sudo[101332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e
Sep 08 16:43:58 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:58 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.270s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:58 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Deleted volume successfully.
Sep 08 16:43:58 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-98131902-f3d7-42bd-bf97-9720ea5121bf tempest-ProjectReaderTests-1863064615 None] Lock "cinder-d73c96bd-3927-449f-88fa-08717f3361d6-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:58 devstack sudo[101339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5
Sep 08 16:43:58 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:58 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e" returned: 0 in 0.414s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:58 devstack sudo[101344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e
Sep 08 16:43:58 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:58 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-571f77a0-374b-4d93-8416-e73ea8908ea5" returned: 0 in 0.304s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Lock "cinder-quobyte-571f77a0-374b-4d93-8416-e73ea8908ea5" released by "delete_volume" :: held 0.776s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Created reservations ['523fe7fc-3ab1-4d70-92d3-42a51230dee1', '34a301f6-6a9c-43a3-8d2c-04cba71c4ad5', '2013c8a9-19ac-408e-a929-d4ceee8de49e', '82aaa6ec-2c5e-4e48-adbe-5cd641eedbba'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:43:58 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (8a40d1a5-8f97-4381-a510-2509bbd2005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d915f2f-2d96-4da3-a804-857410513425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d915f2f-2d96-4da3-a804-857410513425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1750476820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6e0fa4-0367-4240-85e1-2f0f28ca4d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:59Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e124e436-85df-4ec2-a6a4-0ad54a763e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e124e436-85df-4ec2-a6a4-0ad54a763e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b328c5-606d-4dd9-9d03-01cbca629429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b328c5-606d-4dd9-9d03-01cbca629429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6e0fa4-0367-4240-85e1-2f0f28ca4d57', 'volume_name': 'volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90817065-0de2-423d-8f2f-5a12a183c2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90817065-0de2-423d-8f2f-5a12a183c2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b24d743-3246-4e1d-a18f-def3e0af9afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:58 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Volume 7f6e0fa4-0367-4240-85e1-2f0f28ca4d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57', 'volume_size': 1}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1750476820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6e0fa4-0367-4240-85e1-2f0f28ca4d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087514bec61e44be85531e2c288f3515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:43:59Z,use_quota=True,user_id='94700514775a4e96873bea9313710840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Creating volume 7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:43:58 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-quobyte-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e" released by "delete_volume" :: held 0.834s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:58 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 1073741824
Sep 08 16:43:58 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:58 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:58 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:58 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Created reservations ['17f41466-8ac7-4669-aa75-ac142734f1d7', '31f0c289-129b-43c4-849f-e475acb67217', 'dc50eadb-8383-4bb3-8f8d-11b2f472c825', '12307fd5-a60f-496f-bb83-8663da491205'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:59 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:43:59 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "cinder-2e389c3c-196d-4f30-b1be-967051af199b-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-2e389c3c-196d-4f30-b1be-967051af199b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:59 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Deleted volume successfully.
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5faca70a-aa75-4fec-9f8b-9edf40755b80 tempest-VolumesListAdminTestJSON-1622244 None] Lock "cinder-571f77a0-374b-4d93-8416-e73ea8908ea5-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "cinder-quobyte-2e389c3c-196d-4f30-b1be-967051af199b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-quobyte-2e389c3c-196d-4f30-b1be-967051af199b" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1230e6a-8585-410e-a9cd-339a4263a6c1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:59 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:43:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Deleted volume successfully.
Sep 08 16:43:59 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 1073741824" returned: 0 in 0.543s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac71a75e-294b-4ce5-a779-560b7766ce00 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-56cb12d0-c308-4fcf-a1dd-a7d3e9667e8e-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:59 devstack sudo[101358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b
Sep 08 16:43:59 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:59 devstack sudo[101361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57
Sep 08 16:43:59 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:59 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:43:59 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57" returned: 0 in 0.250s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:43:59 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:43:59 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b24d743-3246-4e1d-a18f-def3e0af9afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce537243-20ac-435c-b944-7c34f1062cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:43:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Volume volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 (7f6e0fa4-0367-4240-85e1-2f0f28ca4d57): created successfully
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce537243-20ac-435c-b944-7c34f1062cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Flow 'volume_create_manager' (8a40d1a5-8f97-4381-a510-2509bbd2005a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:43:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-da11d60f-b1e0-4e2c-8868-e73ec193f64e tempest-ProjectReaderTests-1863064615 None] Created volume successfully.
Sep 08 16:43:59 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e389c3c-196d-4f30-b1be-967051af199b" returned: 0 in 0.235s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-quobyte-2e389c3c-196d-4f30-b1be-967051af199b" released by "delete_volume" :: held 0.648s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:43:59 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Created reservations ['2dcfda3e-d5b4-470f-bb2f-c7b574db9d2a', 'b4ca1839-90f2-4fd3-a08a-41f8848837d0', '654340f5-3648-4073-9b02-34ea683f4d62', 'bdfe8c22-5a54-402c-8cfe-4bda32aea461'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:00 devstack sudo[101370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:44:00 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:00 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.230s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:44:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Deleted volume successfully.
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-85176420-c870-49e3-94f6-29d225e14f29 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-2e389c3c-196d-4f30-b1be-967051af199b-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "cinder-c0f31312-0cc6-40ee-920b-e53bc8af0541-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-c0f31312-0cc6-40ee-920b-e53bc8af0541-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "cinder-quobyte-c0f31312-0cc6-40ee-920b-e53bc8af0541" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-quobyte-c0f31312-0cc6-40ee-920b-e53bc8af0541" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a66a37-1681-4a67-b068-ba3f6039b5df]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:00 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541
Sep 08 16:44:00 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "cinder-quobyte-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:00 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541" returned: 0 in 0.370s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:00 devstack sudo[101378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541
Sep 08 16:44:00 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a903d36-8235-408e-8360-d773f942063e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:44:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:01 devstack sudo[101380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57
Sep 08 16:44:01 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:01 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c0f31312-0cc6-40ee-920b-e53bc8af0541" returned: 0 in 0.253s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-quobyte-c0f31312-0cc6-40ee-920b-e53bc8af0541" released by "delete_volume" :: held 0.670s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Created reservations ['35164fd3-d1a8-4b88-a6ec-945d34f7e2b6', '6ba83ce1-f2b3-4863-a4df-f2271c685896', '9d5f7a55-2951-45f5-b2e6-4257f60e184e', 'c30e2add-3014-4175-8eb5-e3c4fda56750'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:44:01 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57" returned: 0 in 0.379s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:01 devstack sudo[101386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:44:01 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:01 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57
Sep 08 16:44:01 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:01 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:01 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57" returned: 0 in 0.250s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.272s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-quobyte-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57" released by "delete_volume" :: held 0.685s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Deleted volume successfully.
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-54061d48-30d1-4653-9604-8efc5b143e43 tempest-VolumesListAdminTestJSON-576950517 None] Lock "cinder-c0f31312-0cc6-40ee-920b-e53bc8af0541-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Created reservations ['b3cccbd8-6fd3-469e-b71c-bf89e584159a', '31d96e83-4804-432e-bdec-8a4e9685681d', '4ad9f625-30e8-4297-91df-a7cc98d1b39c', '054eee55-f95a-4dc9-9407-f426f15925dd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:01 devstack sudo[101392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:44:01 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:02 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.263s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:02 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:44:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Deleted volume successfully.
Sep 08 16:44:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-48e02ec4-6275-4e54-83a1-48c7d5c0ebc0 tempest-ProjectReaderTests-1863064615 None] Lock "cinder-7f6e0fa4-0367-4240-85e1-2f0f28ca4d57-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Flow 'volume_create_manager' (4fe85a72-b45f-4d0b-bf34-a6207150189c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e888aa-be71-405f-a0d4-46decde6eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e888aa-be71-405f-a0d4-46decde6eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2082833227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c918e9-560a-4e9a-93f4-11c2fe7a6f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192c947ddd2f4d56ac9d1a1ec8f24455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:44:07Z,use_quota=True,user_id='96325c741a79494aa47423770a368410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77149ee-bd32-4308-ae43-d74418dce78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77149ee-bd32-4308-ae43-d74418dce78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5566030-4c19-4901-9ba3-b3db3678620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5566030-4c19-4901-9ba3-b3db3678620e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c918e9-560a-4e9a-93f4-11c2fe7a6f00', 'volume_name': 'volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26d8bac-08ae-4457-a295-54d76a4151d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26d8bac-08ae-4457-a295-54d76a4151d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7077f16-9f9d-4eb6-8c08-2b9d5dd192ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:06 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Volume 19c918e9-560a-4e9a-93f4-11c2fe7a6f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00', 'volume_size': 1}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2082833227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c918e9-560a-4e9a-93f4-11c2fe7a6f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='192c947ddd2f4d56ac9d1a1ec8f24455',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:44:07Z,use_quota=True,user_id='96325c741a79494aa47423770a368410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Creating volume 19c918e9-560a-4e9a-93f4-11c2fe7a6f00 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:44:06 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:44:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:06 devstack sudo[101396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00 1073741824
Sep 08 16:44:06 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:07 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00 1073741824" returned: 0 in 0.418s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:07 devstack sudo[101402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00
Sep 08 16:44:07 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:07 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7077f16-9f9d-4eb6-8c08-2b9d5dd192ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59fda96-87bb-4954-bdc1-ebb0cd97190c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Volume volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00 (19c918e9-560a-4e9a-93f4-11c2fe7a6f00): created successfully
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59fda96-87bb-4954-bdc1-ebb0cd97190c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Flow 'volume_create_manager' (4fe85a72-b45f-4d0b-bf34-a6207150189c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:44:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6b64ff41-a8c4-49e0-9c3c-0a1a0accfce8 tempest-VolumesMetadataTest-1060069150 None] Created volume successfully.
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Acquiring lock "cinder-19c918e9-560a-4e9a-93f4-11c2fe7a6f00-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Lock "cinder-19c918e9-560a-4e9a-93f4-11c2fe7a6f00-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Acquiring lock "cinder-quobyte-19c918e9-560a-4e9a-93f4-11c2fe7a6f00" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Lock "cinder-quobyte-19c918e9-560a-4e9a-93f4-11c2fe7a6f00" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa42ff63-90cc-4195-ab77-214279968847]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:08 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00
Sep 08 16:44:08 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:08 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:08 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00
Sep 08 16:44:08 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:09 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-19c918e9-560a-4e9a-93f4-11c2fe7a6f00" returned: 0 in 0.232s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Lock "cinder-quobyte-19c918e9-560a-4e9a-93f4-11c2fe7a6f00" released by "delete_volume" :: held 0.601s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Created reservations ['3ef648e7-aa3e-4f4c-9273-32b7aa84aac3', 'b3c7bcbd-3397-4d33-b8b0-9df9f6bdc429', 'f40ae4dd-39dd-4996-8b96-ae555b735c5b', '1ee13e86-c084-4f3f-bee8-9e7ed1285308'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:09 devstack sudo[101419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:44:09 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:09 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:44:09 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Deleted volume successfully.
Sep 08 16:44:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-25572f90-897c-40cb-b92c-c9c91e32ccd6 tempest-VolumesMetadataTest-1060069150 None] Lock "cinder-19c918e9-560a-4e9a-93f4-11c2fe7a6f00-delete_volume" released by "delete_volume" :: held 1.017s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:19 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=105,cinder:SELECT=67,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:44:19 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=58,cinder:INSERT=25,cinder:UPDATE=92,cinder:DELETE=11 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Flow 'volume_create_manager' (93c6503d-6a8d-4902-b591-1430f704c12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da2de76-a365-489d-b3fe-0d8970d83e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da2de76-a365-489d-b3fe-0d8970d83e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644057112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c68699-2388-41c9-9b33-2010941f7dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff63da77f00e4c2f95470f103d94cc40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:44:21Z,use_quota=True,user_id='53f8db45c8c64a8da10eb9ad1ea7eaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be70c71-0c94-4a83-85cc-6ccefdb6655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be70c71-0c94-4a83-85cc-6ccefdb6655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da02c05-a545-4103-abe7-da059131f250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2da02c05-a545-4103-abe7-da059131f250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c68699-2388-41c9-9b33-2010941f7dce', 'volume_name': 'volume-11c68699-2388-41c9-9b33-2010941f7dce', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa42a6a-897b-4a72-92ca-7d68e08f2415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa42a6a-897b-4a72-92ca-7d68e08f2415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67356768-2c09-4cef-a8a7-378f8139e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Volume 11c68699-2388-41c9-9b33-2010941f7dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c68699-2388-41c9-9b33-2010941f7dce', 'volume_size': 1}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644057112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c68699-2388-41c9-9b33-2010941f7dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff63da77f00e4c2f95470f103d94cc40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:44:21Z,use_quota=True,user_id='53f8db45c8c64a8da10eb9ad1ea7eaf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Creating volume 11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:44:21 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:21 devstack sudo[101424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce 1073741824
Sep 08 16:44:21 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:21 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce 1073741824" returned: 0 in 0.387s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:21 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:44:21 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:21 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.223s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] <== create_volume: return (646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67356768-2c09-4cef-a8a7-378f8139e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c68699-2388-41c9-9b33-2010941f7dce', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052d84b6-1f40-42ca-bbc8-88ce2731a8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:44:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Volume volume-11c68699-2388-41c9-9b33-2010941f7dce (11c68699-2388-41c9-9b33-2010941f7dce): created successfully
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052d84b6-1f40-42ca-bbc8-88ce2731a8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:44:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Flow 'volume_create_manager' (93c6503d-6a8d-4902-b591-1430f704c12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:44:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-478aaa4d-1d22-4ed6-9653-15b4cdf9898f tempest-VolumesActionsTest-291054661 None] Created volume successfully.
Sep 08 16:44:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1a6bc11e-13fe-4976-9b7e-26eae630e087 tempest-VolumesActionsTest-291054661 None] Acquiring lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce" by "attach_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1a6bc11e-13fe-4976-9b7e-26eae630e087 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce" acquired by "attach_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1a6bc11e-13fe-4976-9b7e-26eae630e087 tempest-VolumesActionsTest-291054661 None] Attaching volume 11c68699-2388-41c9-9b33-2010941f7dce to instance a30efb17-83e0-40ed-bdbe-bb077f7b8a24 at mountpoint /dev/vdb on host None.
Sep 08 16:44:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1a6bc11e-13fe-4976-9b7e-26eae630e087 tempest-VolumesActionsTest-291054661 None] Attach volume completed successfully.
Sep 08 16:44:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1a6bc11e-13fe-4976-9b7e-26eae630e087 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce" released by "attach_volume" :: held 0.088s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-160e051e-1a2c-4d31-b63c-6b9e5516b86f tempest-VolumesActionsTest-291054661 None] Acquiring lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-detach_volume" by "detach_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-160e051e-1a2c-4d31-b63c-6b9e5516b86f tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-160e051e-1a2c-4d31-b63c-6b9e5516b86f tempest-VolumesActionsTest-291054661 None] Detaching volume 11c68699-2388-41c9-9b33-2010941f7dce from instance a30efb17-83e0-40ed-bdbe-bb077f7b8a24.
Sep 08 16:44:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-160e051e-1a2c-4d31-b63c-6b9e5516b86f tempest-VolumesActionsTest-291054661 None] Detach volume completed successfully.
Sep 08 16:44:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-160e051e-1a2c-4d31-b63c-6b9e5516b86f tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a5247b1-0b19-4f29-8410-89b419f364c1 tempest-VolumesActionsTest-291054661 None] Acquiring lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce" by "attach_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a5247b1-0b19-4f29-8410-89b419f364c1 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce" acquired by "attach_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0a5247b1-0b19-4f29-8410-89b419f364c1 tempest-VolumesActionsTest-291054661 None] Attaching volume 11c68699-2388-41c9-9b33-2010941f7dce to instance 1840a3c1-6b87-4c5b-acfd-6cf73a83e415 at mountpoint /dev/vdb on host None.
Sep 08 16:44:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0a5247b1-0b19-4f29-8410-89b419f364c1 tempest-VolumesActionsTest-291054661 None] Attach volume completed successfully.
Sep 08 16:44:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0a5247b1-0b19-4f29-8410-89b419f364c1 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce" released by "attach_volume" :: held 0.093s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-526bc9f1-6366-402d-8349-5e69a4c9a316 tempest-VolumesActionsTest-291054661 None] Acquiring lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-detach_volume" by "detach_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:44:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-526bc9f1-6366-402d-8349-5e69a4c9a316 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:44:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-526bc9f1-6366-402d-8349-5e69a4c9a316 tempest-VolumesActionsTest-291054661 None] Detaching volume 11c68699-2388-41c9-9b33-2010941f7dce from instance 1840a3c1-6b87-4c5b-acfd-6cf73a83e415.
Sep 08 16:44:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-526bc9f1-6366-402d-8349-5e69a4c9a316 tempest-VolumesActionsTest-291054661 None] Detach volume completed successfully.
Sep 08 16:44:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-526bc9f1-6366-402d-8349-5e69a4c9a316 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:44:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:42 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ef7cd-6c0c-491c-a90c-07802d830740]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:44:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:42 devstack sudo[101659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:44:42 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:43 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.367s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:43 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a41e3e-374a-43f7-a2de-59ed5f6ca6bb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:44:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:43 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:44:43 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:43 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.356s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.389caf90-7523-4d72-af13-ffcac9d196f1syeizp4v.img {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:43 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.389caf90-7523-4d72-af13-ffcac9d196f1syeizp4v.img
Sep 08 16:44:43 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:47 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.389caf90-7523-4d72-af13-ffcac9d196f1syeizp4v.img" returned: 0 in 3.592s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:47 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb2ee28-cf70-4eac-9557-c3b07e54aba3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:44:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:47 devstack sudo[101683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:44:47 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:47 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.510s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:47 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce, size 1024.00 MB, duration 3.59 sec, destination /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.389caf90-7523-4d72-af13-ffcac9d196f1syeizp4v.img {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:44:47 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Converted 1024.00 MB image at 284.94 MB/s
Sep 08 16:44:47 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] 389caf90-7523-4d72-af13-ffcac9d196f1 was raw, no need to convert to raw {{(pid=87505) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:44:56 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:44:56 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:44:56 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.256s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:44:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:44:57 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:44:57 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:45:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.255s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Uploaded volume to glance image-id: 389caf90-7523-4d72-af13-ffcac9d196f1. {{(pid=87505) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 08 16:45:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-85888222-a7e2-4f6d-9bdd-870b25bffc48 tempest-VolumesActionsTest-291054661 None] Copy volume to image completed successfully.
Sep 08 16:45:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e2c17-cbf7-406d-b8b2-eee1b470c6c3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:07 devstack sudo[101734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:45:07 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:07 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.353s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[82abdf74-8ca5-4499-a37e-a275446a500c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:07 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:45:07 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:08 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.335s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:08 devstack sudo[101744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img
Sep 08 16:45:08 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:11 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img" returned: 0 in 3.500s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:11 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10f9d67-1f2f-44ca-9e17-183fc72dd88a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:11 devstack sudo[101763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:45:11 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:12 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.473s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce, size 1024.00 MB, duration 3.50 sec, destination /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:45:12 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Converted 1024.00 MB image at 292.49 MB/s
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] 486b53e5-1d1c-49f9-82e3-784729332cdd was raw, converting to qcow2 {{(pid=87505) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a511cb8b-4b0f-4322-a97c-3f9d49a53a62]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:12 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img
Sep 08 16:45:12 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:12 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img" returned: 0 in 0.299s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:12 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img
Sep 08 16:45:12 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:12 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img" returned: 1 in 0.313s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img /opt/stack/data/cinder/conversion/vol_upload_desh6286 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:12 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img /opt/stack/data/cinder/conversion/vol_upload_desh6286
Sep 08 16:45:12 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:12 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img /opt/stack/data/cinder/conversion/vol_upload_desh6286" returned: 0 in 0.251s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Image conversion details: src /opt/stack/data/cinder/conversion/11c68699-2388-41c9-9b33-2010941f7dce.temp_image.486b53e5-1d1c-49f9-82e3-784729332cddbko4blgn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_desh6286 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:45:12 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc73976-5bfd-4507-b4ef-674275ec6a83]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_desh6286 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:13 devstack sudo[101782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_desh6286
Sep 08 16:45:13 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:13 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_desh6286" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.102s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Uploaded volume to glance image-id: 486b53e5-1d1c-49f9-82e3-784729332cdd. {{(pid=87505) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 08 16:45:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d9d6d5b6-94aa-42e4-a2c9-f64e5228be79 tempest-VolumesActionsTest-291054661 None] Copy volume to image completed successfully.
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Acquiring lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Acquiring lock "cinder-quobyte-11c68699-2388-41c9-9b33-2010941f7dce" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Lock "cinder-quobyte-11c68699-2388-41c9-9b33-2010941f7dce" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee11b826-a130-4f32-af95-7a79a07db4f9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:15 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:45:15 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:15 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.358s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:15 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce
Sep 08 16:45:15 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:15 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-11c68699-2388-41c9-9b33-2010941f7dce" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Lock "cinder-quobyte-11c68699-2388-41c9-9b33-2010941f7dce" released by "delete_volume" :: held 0.628s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:15 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Created reservations ['71f6f0ca-2df3-42a1-be90-671dbfa93c7a', '6cbe722b-0462-4089-b85c-642945b213ab', '71c71af0-8f96-4d3f-bb3d-8d4ebdfbea1e', 'fe85009f-676c-4ae1-8e87-2f9df3eefb55'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:16 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:45:16 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:16 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:45:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Deleted volume successfully.
Sep 08 16:45:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9ed04b10-0267-4274-9b71-12f5b3342753 tempest-VolumesActionsTest-291054661 None] Lock "cinder-11c68699-2388-41c9-9b33-2010941f7dce-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Flow 'volume_create_manager' (c8e0905f-9c20-4e43-a8f1-b20dc87db40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58267951-129c-4ab4-bd2f-13efedfa210a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58267951-129c-4ab4-bd2f-13efedfa210a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1472248423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9160ca2-6808-421c-9280-08e2ce6656b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c459639ebfcb42bd898d9e863b1e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:26Z,use_quota=True,user_id='afa02d884c4142fe95470b68e2f231aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e153017-b0a7-40a7-82f7-2cf15f3bde48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e153017-b0a7-40a7-82f7-2cf15f3bde48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bd35dd-193e-43c1-be64-7e986b951b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bd35dd-193e-43c1-be64-7e986b951b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9160ca2-6808-421c-9280-08e2ce6656b1', 'volume_name': 'volume-a9160ca2-6808-421c-9280-08e2ce6656b1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82db63a0-f8f9-435c-b129-be6c6a223a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82db63a0-f8f9-435c-b129-be6c6a223a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4251def-8293-4573-a8ff-9bc46b6d4412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:26 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Volume a9160ca2-6808-421c-9280-08e2ce6656b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9160ca2-6808-421c-9280-08e2ce6656b1', 'volume_size': 1}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1472248423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9160ca2-6808-421c-9280-08e2ce6656b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c459639ebfcb42bd898d9e863b1e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:26Z,use_quota=True,user_id='afa02d884c4142fe95470b68e2f231aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Creating volume a9160ca2-6808-421c-9280-08e2ce6656b1 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:45:26 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:26 devstack sudo[101803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1 1073741824
Sep 08 16:45:26 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:26 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1 1073741824" returned: 0 in 0.378s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:26 devstack sudo[101809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1
Sep 08 16:45:26 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:26 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1" returned: 0 in 0.223s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] <== create_volume: return (640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.643s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4251def-8293-4573-a8ff-9bc46b6d4412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9160ca2-6808-421c-9280-08e2ce6656b1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08548f1-e7bc-46f9-8239-f7e88304eebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:26 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Volume volume-a9160ca2-6808-421c-9280-08e2ce6656b1 (a9160ca2-6808-421c-9280-08e2ce6656b1): created successfully
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08548f1-e7bc-46f9-8239-f7e88304eebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Flow 'volume_create_manager' (c8e0905f-9c20-4e43-a8f1-b20dc87db40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-405d878f-b786-405e-ae5b-d45adfc4e966 tempest-VolumesListTestJSON-675551130 None] Created volume successfully.
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Flow 'volume_create_manager' (4ffe4f5a-5376-4a21-87c2-cfc521cb09fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04894ec-939e-4ccc-b96c-8eab4432f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04894ec-939e-4ccc-b96c-8eab4432f552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1889054291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af472656-aa2f-4df4-8ad1-e9de4dea96d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c459639ebfcb42bd898d9e863b1e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:27Z,use_quota=True,user_id='afa02d884c4142fe95470b68e2f231aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a66613-b937-43a5-a2e8-8ea25848071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a66613-b937-43a5-a2e8-8ea25848071e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a91d85-2203-4a33-ab7c-4f4a3c0db4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92a91d85-2203-4a33-ab7c-4f4a3c0db4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af472656-aa2f-4df4-8ad1-e9de4dea96d5', 'volume_name': 'volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7bf189-8666-4de8-9b7a-03bd44fa15ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7bf189-8666-4de8-9b7a-03bd44fa15ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e9ca50-0ca8-4d4e-96c9-40ae400a55c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:27 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Volume af472656-aa2f-4df4-8ad1-e9de4dea96d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5', 'volume_size': 1}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1889054291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af472656-aa2f-4df4-8ad1-e9de4dea96d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c459639ebfcb42bd898d9e863b1e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:27Z,use_quota=True,user_id='afa02d884c4142fe95470b68e2f231aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Creating volume af472656-aa2f-4df4-8ad1-e9de4dea96d5 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:45:27 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:27 devstack sudo[101812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5 1073741824
Sep 08 16:45:27 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:27 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5 1073741824" returned: 0 in 0.387s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:27 devstack sudo[101817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5
Sep 08 16:45:27 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:28 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5" returned: 0 in 0.229s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] <== create_volume: return (655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e9ca50-0ca8-4d4e-96c9-40ae400a55c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5703563-2839-4d89-80b6-bda7deb790c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:28 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Volume volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5 (af472656-aa2f-4df4-8ad1-e9de4dea96d5): created successfully
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5703563-2839-4d89-80b6-bda7deb790c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Flow 'volume_create_manager' (4ffe4f5a-5376-4a21-87c2-cfc521cb09fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:28 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0d9c2a2e-6feb-4ae5-b94b-47360a20a5c0 tempest-VolumesListTestJSON-675551130 None] Created volume successfully.
Sep 08 16:45:28 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Flow 'volume_create_manager' (fddf2a22-5c02-4a78-999a-070fd4f734ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dacc8ea-6b13-4059-814c-3c3cff9a30aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dacc8ea-6b13-4059-814c-3c3cff9a30aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1535396622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c60a8c-b741-42c7-9664-6b5631fb5db3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c459639ebfcb42bd898d9e863b1e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:29Z,use_quota=True,user_id='afa02d884c4142fe95470b68e2f231aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03827a3-295e-4f18-99d8-dada175d2d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03827a3-295e-4f18-99d8-dada175d2d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da995689-b3fa-43cd-8132-392d53da8b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da995689-b3fa-43cd-8132-392d53da8b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c60a8c-b741-42c7-9664-6b5631fb5db3', 'volume_name': 'volume-74c60a8c-b741-42c7-9664-6b5631fb5db3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a77b52-310f-48fb-b0e5-84e0de2c64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a77b52-310f-48fb-b0e5-84e0de2c64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f48f082-d379-4a47-b67a-741d87712f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:29 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Volume 74c60a8c-b741-42c7-9664-6b5631fb5db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c60a8c-b741-42c7-9664-6b5631fb5db3', 'volume_size': 1}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1535396622',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c60a8c-b741-42c7-9664-6b5631fb5db3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c459639ebfcb42bd898d9e863b1e81fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:29Z,use_quota=True,user_id='afa02d884c4142fe95470b68e2f231aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Creating volume 74c60a8c-b741-42c7-9664-6b5631fb5db3 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:45:29 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:29 devstack sudo[101821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3 1073741824
Sep 08 16:45:29 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:29 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3 1073741824" returned: 0 in 0.389s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:29 devstack sudo[101827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3
Sep 08 16:45:29 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:29 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3" returned: 0 in 0.234s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f48f082-d379-4a47-b67a-741d87712f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c60a8c-b741-42c7-9664-6b5631fb5db3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee7b94d-e2e9-4fe6-a2cd-12b81af1194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:29 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Volume volume-74c60a8c-b741-42c7-9664-6b5631fb5db3 (74c60a8c-b741-42c7-9664-6b5631fb5db3): created successfully
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee7b94d-e2e9-4fe6-a2cd-12b81af1194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Flow 'volume_create_manager' (fddf2a22-5c02-4a78-999a-070fd4f734ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-357dacbd-91f4-457e-b4b3-dc7c2f1f19e8 tempest-VolumesListTestJSON-675551130 None] Created volume successfully.
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "cinder-74c60a8c-b741-42c7-9664-6b5631fb5db3-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-74c60a8c-b741-42c7-9664-6b5631fb5db3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "cinder-quobyte-74c60a8c-b741-42c7-9664-6b5631fb5db3" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-quobyte-74c60a8c-b741-42c7-9664-6b5631fb5db3" acquired by "delete_volume" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e756b64-5c88-4dad-9e0a-928d6ce4a88d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:32 devstack sudo[101832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3
Sep 08 16:45:32 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:32 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3" returned: 0 in 0.352s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:32 devstack sudo[101837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3
Sep 08 16:45:32 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:32 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-74c60a8c-b741-42c7-9664-6b5631fb5db3" returned: 0 in 0.246s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-quobyte-74c60a8c-b741-42c7-9664-6b5631fb5db3" released by "delete_volume" :: held 0.635s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Created reservations ['4e638451-5d35-4087-942f-c8368bee72a4', 'd2a1b035-5218-4d50-9100-205577ae41d2', '13c0c0d6-f502-4a73-83ed-87abcc4e9f2f', '63670c35-1415-4298-b0e0-40ee32f907e9'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:32 devstack sudo[101840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:45:32 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:33 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:45:33 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Deleted volume successfully.
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0cd2961e-0b0c-4ffe-92e6-1c82c3fc2457 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-74c60a8c-b741-42c7-9664-6b5631fb5db3-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "cinder-af472656-aa2f-4df4-8ad1-e9de4dea96d5-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-af472656-aa2f-4df4-8ad1-e9de4dea96d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "cinder-quobyte-af472656-aa2f-4df4-8ad1-e9de4dea96d5" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-quobyte-af472656-aa2f-4df4-8ad1-e9de4dea96d5" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c3251a-aed0-4266-a63b-6044748fbf10]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:33 devstack sudo[101843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5
Sep 08 16:45:33 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:33 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5" returned: 0 in 0.367s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:33 devstack sudo[101849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5
Sep 08 16:45:33 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:34 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af472656-aa2f-4df4-8ad1-e9de4dea96d5" returned: 0 in 0.243s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-quobyte-af472656-aa2f-4df4-8ad1-e9de4dea96d5" released by "delete_volume" :: held 0.648s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Created reservations ['ba4e6ac6-f23a-4eb8-8ec1-9314b3e78157', '6d405615-6bb7-4d23-b7d9-63a115e09b22', 'edb857e5-f370-4c9f-bbb7-bb0157cb76eb', '8eba9121-d337-4c36-b661-a695f7f32aba'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:34 devstack sudo[101852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:45:34 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:34 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.263s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:45:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Deleted volume successfully.
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-398d155b-f063-4ab9-b4c2-0663cfe15ac7 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-af472656-aa2f-4df4-8ad1-e9de4dea96d5-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "cinder-a9160ca2-6808-421c-9280-08e2ce6656b1-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-a9160ca2-6808-421c-9280-08e2ce6656b1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "cinder-quobyte-a9160ca2-6808-421c-9280-08e2ce6656b1" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-quobyte-a9160ca2-6808-421c-9280-08e2ce6656b1" acquired by "delete_volume" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[754546d8-8827-4684-9e98-dc8e49328a1e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:34 devstack sudo[101855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1
Sep 08 16:45:34 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:34 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1" returned: 0 in 0.347s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:34 devstack sudo[101860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1
Sep 08 16:45:34 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:35 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-a9160ca2-6808-421c-9280-08e2ce6656b1" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-quobyte-a9160ca2-6808-421c-9280-08e2ce6656b1" released by "delete_volume" :: held 0.620s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Created reservations ['838a3195-9a21-44f3-a34e-4078e062fd6f', '2fee982d-4cd3-4594-bd67-d5085936ea72', '0121070b-3792-4d42-be4d-e1821d25e2f5', '9454c872-4fe0-4b15-8f85-971878726003'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:35 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:45:35 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:35 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:45:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Deleted volume successfully.
Sep 08 16:45:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e160376e-eabc-4886-aba6-f1c864fac117 tempest-VolumesListTestJSON-675551130 None] Lock "cinder-a9160ca2-6808-421c-9280-08e2ce6656b1-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Flow 'volume_create_manager' (8cec1b02-6bbf-4eac-9cf8-05f6060c83db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47143b88-b214-462b-a599-9f8f38c79763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47143b88-b214-462b-a599-9f8f38c79763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-43007030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebb7ef3-e624-4572-8025-2a2bee79cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7497283a7147828f79a23242902def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:39Z,use_quota=True,user_id='4a045f7d8a51463eae0d0a6d5a6c2d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2de9fd-ecd9-448c-a9f9-5918ad700bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2de9fd-ecd9-448c-a9f9-5918ad700bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6391536-36cc-4726-928f-36e20728053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6391536-36cc-4726-928f-36e20728053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebb7ef3-e624-4572-8025-2a2bee79cdf8', 'volume_name': 'volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3c9df7-95ee-467d-ad4e-a55292fa4e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3c9df7-95ee-467d-ad4e-a55292fa4e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bab7eb-1edf-465b-a9fa-8d2210c2e7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:39 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Volume 7ebb7ef3-e624-4572-8025-2a2bee79cdf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8', 'volume_size': 1}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-43007030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebb7ef3-e624-4572-8025-2a2bee79cdf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7497283a7147828f79a23242902def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:45:39Z,use_quota=True,user_id='4a045f7d8a51463eae0d0a6d5a6c2d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Creating volume 7ebb7ef3-e624-4572-8025-2a2bee79cdf8 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:45:39 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:39 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8 1073741824
Sep 08 16:45:39 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:39 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8 1073741824" returned: 0 in 0.420s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:39 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8
Sep 08 16:45:39 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:39 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9bab7eb-1edf-465b-a9fa-8d2210c2e7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4365ad51-b328-4876-b2f0-76fcfc5d7c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:45:39 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Volume volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8 (7ebb7ef3-e624-4572-8025-2a2bee79cdf8): created successfully
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4365ad51-b328-4876-b2f0-76fcfc5d7c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:45:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Flow 'volume_create_manager' (8cec1b02-6bbf-4eac-9cf8-05f6060c83db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:45:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-3c5a9b16-42ca-4575-8797-0dadffad774e tempest-VolumesNegativeTest-732615781 None] Created volume successfully.
Sep 08 16:45:49 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=52,cinder:SELECT=28,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:45:50 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=33,cinder:UPDATE=38,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Acquiring lock "cinder-7ebb7ef3-e624-4572-8025-2a2bee79cdf8-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Lock "cinder-7ebb7ef3-e624-4572-8025-2a2bee79cdf8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Acquiring lock "cinder-quobyte-7ebb7ef3-e624-4572-8025-2a2bee79cdf8" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Lock "cinder-quobyte-7ebb7ef3-e624-4572-8025-2a2bee79cdf8" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[512e27c3-49f2-4696-9b4c-6749ca47b850]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:56 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8
Sep 08 16:45:56 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:56 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8" returned: 0 in 0.361s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:56 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8
Sep 08 16:45:56 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:56 devstack sudo[102036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:45:56 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:56 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7ebb7ef3-e624-4572-8025-2a2bee79cdf8" returned: 0 in 0.240s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Lock "cinder-quobyte-7ebb7ef3-e624-4572-8025-2a2bee79cdf8" released by "delete_volume" :: held 0.644s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:45:56 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.241s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Created reservations ['07324467-68a9-4030-92e2-f38d121b3040', '76d91ade-f45a-4f54-9f42-71617671a4a4', 'd9704af9-b8b4-4b97-aa31-65190d4d405c', '81990499-6163-4888-b636-1fba715c81ff'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:45:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:45:56 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:45:56 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:45:57 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Sep 08 16:45:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:45:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:45:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Deleted volume successfully.
Sep 08 16:45:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-17ebb6a0-befe-403c-8ef1-a41348508070 tempest-VolumesNegativeTest-732615781 None] Lock "cinder-7ebb7ef3-e624-4572-8025-2a2bee79cdf8-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:46:06 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:46:07 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Flow 'volume_create_manager' (9d5b8adf-68cc-436b-ad37-a9d68d1d27f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1644177-44d4-42c7-b871-08c77cf4d8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1644177-44d4-42c7-b871-08c77cf4d8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-846675761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3fac9c-8603-447f-b638-4fe08d8e17ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1995cfd4876a447388a994aeeeffe5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:46:30Z,use_quota=True,user_id='63ba6a87051c4e068386164000f1c52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3686ca0d-3f25-4f5e-9428-bcd43217141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3686ca0d-3f25-4f5e-9428-bcd43217141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68b598f-83b0-4273-ad03-4d6c0cc51310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68b598f-83b0-4273-ad03-4d6c0cc51310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3fac9c-8603-447f-b638-4fe08d8e17ed', 'volume_name': 'volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056a066f-9d82-4356-8ac3-c80ff8911e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056a066f-9d82-4356-8ac3-c80ff8911e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc91a06-e596-4add-b705-dde06b744380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:46:29 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Volume 5f3fac9c-8603-447f-b638-4fe08d8e17ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed', 'volume_size': 1}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-846675761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3fac9c-8603-447f-b638-4fe08d8e17ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1995cfd4876a447388a994aeeeffe5ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:46:30Z,use_quota=True,user_id='63ba6a87051c4e068386164000f1c52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Creating volume 5f3fac9c-8603-447f-b638-4fe08d8e17ed {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:46:29 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:46:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:46:29 devstack sudo[102158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed 1073741824
Sep 08 16:46:29 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:46:30 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed 1073741824" returned: 0 in 0.405s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:46:30 devstack sudo[102163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed
Sep 08 16:46:30 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:46:30 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed" returned: 0 in 0.235s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc91a06-e596-4add-b705-dde06b744380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab56232-3c77-4ee4-bfa5-3a916a4bb021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:46:30 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Volume volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed (5f3fac9c-8603-447f-b638-4fe08d8e17ed): created successfully
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab56232-3c77-4ee4-bfa5-3a916a4bb021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:46:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Flow 'volume_create_manager' (9d5b8adf-68cc-436b-ad37-a9d68d1d27f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:46:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7157fe0d-1215-4624-97fc-a9a8d1749ea7 tempest-TestMinimumBasicScenario-1335385577 None] Created volume successfully.
Sep 08 16:46:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-04a80984-ee45-4ee0-a37d-955d3d3eddc1 req-f92d4afc-ecd7-40e5-955f-6685c98e8e76 tempest-TestMinimumBasicScenario-1335385577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:46:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-04a80984-ee45-4ee0-a37d-955d3d3eddc1 req-f92d4afc-ecd7-40e5-955f-6685c98e8e76 tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:46:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-04a80984-ee45-4ee0-a37d-955d3d3eddc1 req-f92d4afc-ecd7-40e5-955f-6685c98e8e76 tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:46:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-04a80984-ee45-4ee0-a37d-955d3d3eddc1 req-f92d4afc-ecd7-40e5-955f-6685c98e8e76 tempest-TestMinimumBasicScenario-1335385577 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a91e7db-3468-479d-b61d-b255ab5c7398', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:46:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-04a80984-ee45-4ee0-a37d-955d3d3eddc1 req-f92d4afc-ecd7-40e5-955f-6685c98e8e76 tempest-TestMinimumBasicScenario-1335385577 None] attachment_update completed successfully.
Sep 08 16:46:41 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:46:41 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:46:56 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:46:56 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:46:56 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.267s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:46:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:47:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-2e282e19-282c-4c45-b40a-bdd312b88882 req-863b6840-2003-42a2-91c8-1080fe1f8cd1 tempest-TestMinimumBasicScenario-1335385577 None] Terminate volume connection completed successfully.
Sep 08 16:47:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-2e282e19-282c-4c45-b40a-bdd312b88882 req-863b6840-2003-42a2-91c8-1080fe1f8cd1 tempest-TestMinimumBasicScenario-1335385577 None] Deleting attachment 2a91e7db-3468-479d-b61d-b255ab5c7398. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Acquiring lock "cinder-5f3fac9c-8603-447f-b638-4fe08d8e17ed-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Lock "cinder-5f3fac9c-8603-447f-b638-4fe08d8e17ed-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Acquiring lock "cinder-quobyte-5f3fac9c-8603-447f-b638-4fe08d8e17ed" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Lock "cinder-quobyte-5f3fac9c-8603-447f-b638-4fe08d8e17ed" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e804a061-1eea-484e-a233-edc06d19673e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:18 devstack sudo[102720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed
Sep 08 16:47:18 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:18 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed" returned: 0 in 0.337s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:18 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed
Sep 08 16:47:18 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:19 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5f3fac9c-8603-447f-b638-4fe08d8e17ed" returned: 0 in 0.234s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Lock "cinder-quobyte-5f3fac9c-8603-447f-b638-4fe08d8e17ed" released by "delete_volume" :: held 0.606s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Created reservations ['3cde4950-ecc6-4981-bbf4-2d114a4c952f', '7d6bc03f-d255-4057-9e71-a7425952a2cb', 'b0bf7bb9-23a0-4953-a583-eb0025b26a1d', 'f46bb9f7-3076-4a1b-b0ee-2d8ddb5e8fc8'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:19 devstack sudo[102728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:47:19 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:19 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.224s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:47:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Deleted volume successfully.
Sep 08 16:47:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e51519e7-8f76-478e-b78e-86076201104b tempest-TestMinimumBasicScenario-1335385577 None] Lock "cinder-5f3fac9c-8603-447f-b638-4fe08d8e17ed-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:47:29 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:47:29 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Flow 'volume_create_manager' (e699ea9a-a2e8-4322-98ca-18401e959568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73092d1-09d9-4b83-80d8-0cc1868668d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73092d1-09d9-4b83-80d8-0cc1868668d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1679839011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1342e6bd-0555-4919-8807-8832a1ada971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5042523d175345a48119ca1df99b9690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:47:49Z,use_quota=True,user_id='63ad9217409741d7add07e599378e293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b8f12-bf93-421d-a2c6-1eaa57d64977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6b8f12-bf93-421d-a2c6-1eaa57d64977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446c18f5-314f-44b2-a1b8-2814fbda497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446c18f5-314f-44b2-a1b8-2814fbda497d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1342e6bd-0555-4919-8807-8832a1ada971', 'volume_name': 'volume-1342e6bd-0555-4919-8807-8832a1ada971', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e900aba-89de-4239-8a74-f882258e2786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e900aba-89de-4239-8a74-f882258e2786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f456bd03-0a02-4a42-a15b-49ab3221b15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Volume 1342e6bd-0555-4919-8807-8832a1ada971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1342e6bd-0555-4919-8807-8832a1ada971', 'volume_size': 1}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1679839011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1342e6bd-0555-4919-8807-8832a1ada971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5042523d175345a48119ca1df99b9690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:47:49Z,use_quota=True,user_id='63ad9217409741d7add07e599378e293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Creating volume 1342e6bd-0555-4919-8807-8832a1ada971 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:47:48 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:47:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:48 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971 1073741824
Sep 08 16:47:48 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Flow 'volume_create_manager' (1dee8c11-ca66-434a-8b7f-e121a602d116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac2a0b7-aa6b-4c7c-be0d-8cab7a72906f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac2a0b7-aa6b-4c7c-be0d-8cab7a72906f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1918855067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7debbd0d-5de4-4a31-991f-4c34f2bf49ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5042523d175345a48119ca1df99b9690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:47:49Z,use_quota=True,user_id='63ad9217409741d7add07e599378e293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512ea506-81fe-4369-8a6c-c80240232d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512ea506-81fe-4369-8a6c-c80240232d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eeefee-2451-473c-b1b3-610eb21d69d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eeefee-2451-473c-b1b3-610eb21d69d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7debbd0d-5de4-4a31-991f-4c34f2bf49ee', 'volume_name': 'volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051a135f-f3c7-4880-ae13-63b91e6a2b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051a135f-f3c7-4880-ae13-63b91e6a2b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fbb8cf-64fe-4a2c-8c04-18fedbe6f7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Volume 7debbd0d-5de4-4a31-991f-4c34f2bf49ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee', 'volume_size': 1}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:47:49 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971 1073741824" returned: 0 in 0.478s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:49 devstack sudo[102773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971
Sep 08 16:47:49 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:49 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971" returned: 0 in 0.253s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1918855067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7debbd0d-5de4-4a31-991f-4c34f2bf49ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5042523d175345a48119ca1df99b9690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:47:49Z,use_quota=True,user_id='63ad9217409741d7add07e599378e293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Creating volume 7debbd0d-5de4-4a31-991f-4c34f2bf49ee {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:47:49 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:49 devstack sudo[102776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee 1073741824
Sep 08 16:47:49 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f456bd03-0a02-4a42-a15b-49ab3221b15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1342e6bd-0555-4919-8807-8832a1ada971', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c899a253-e8d6-49e3-b90e-1e4acb7bd910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Volume volume-1342e6bd-0555-4919-8807-8832a1ada971 (1342e6bd-0555-4919-8807-8832a1ada971): created successfully
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c899a253-e8d6-49e3-b90e-1e4acb7bd910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Flow 'volume_create_manager' (e699ea9a-a2e8-4322-98ca-18401e959568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:47:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-85dd42af-d765-49be-9dde-941ae0313ef7 tempest-TestServerVolumeAttachmentScenario-619321659 None] Created volume successfully.
Sep 08 16:47:50 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee 1073741824" returned: 0 in 0.459s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:50 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee
Sep 08 16:47:50 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:50 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee" returned: 0 in 0.243s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fbb8cf-64fe-4a2c-8c04-18fedbe6f7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96d5a1-ddbe-47cc-9c03-a8d9b21a1656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:47:50 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Volume volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee (7debbd0d-5de4-4a31-991f-4c34f2bf49ee): created successfully
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96d5a1-ddbe-47cc-9c03-a8d9b21a1656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:47:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Flow 'volume_create_manager' (1dee8c11-ca66-434a-8b7f-e121a602d116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:47:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a3234248-257c-480a-b306-f713b7d243c0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Created volume successfully.
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:47:56 devstack sudo[102873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:47:56 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:47:56 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.276s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:47:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:48:00 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:48:00 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:48:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-cd6d2d2e-bcfd-4c8f-862d-b2a3cceb3370 req-43b855ab-3552-4ac7-b6be-fc910eaa6b5f tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:48:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-cd6d2d2e-bcfd-4c8f-862d-b2a3cceb3370 req-43b855ab-3552-4ac7-b6be-fc910eaa6b5f tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:48:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-cd6d2d2e-bcfd-4c8f-862d-b2a3cceb3370 req-43b855ab-3552-4ac7-b6be-fc910eaa6b5f tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:48:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-cd6d2d2e-bcfd-4c8f-862d-b2a3cceb3370 req-43b855ab-3552-4ac7-b6be-fc910eaa6b5f tempest-TestServerVolumeAttachmentScenario-619321659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-1342e6bd-0555-4919-8807-8832a1ada971', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37364723-dad7-4651-b1a0-ab281334d998', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:48:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-cd6d2d2e-bcfd-4c8f-862d-b2a3cceb3370 req-43b855ab-3552-4ac7-b6be-fc910eaa6b5f tempest-TestServerVolumeAttachmentScenario-619321659 None] attachment_update completed successfully.
Sep 08 16:48:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-7896b504-3e7c-4902-9fd0-644b28683c55 req-139c1e9c-10b7-47de-9a40-cae99d225175 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:48:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-7896b504-3e7c-4902-9fd0-644b28683c55 req-139c1e9c-10b7-47de-9a40-cae99d225175 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:48:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-7896b504-3e7c-4902-9fd0-644b28683c55 req-139c1e9c-10b7-47de-9a40-cae99d225175 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:48:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-7896b504-3e7c-4902-9fd0-644b28683c55 req-139c1e9c-10b7-47de-9a40-cae99d225175 tempest-TestServerVolumeAttachmentScenario-619321659 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2806d69c-3f98-4d9b-88f8-fc3b00f6a091', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:48:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-7896b504-3e7c-4902-9fd0-644b28683c55 req-139c1e9c-10b7-47de-9a40-cae99d225175 tempest-TestServerVolumeAttachmentScenario-619321659 None] attachment_update completed successfully.
Sep 08 16:48:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-3bf624a4-f67a-4649-8276-923cf0f66687 req-99f5915b-a16f-4fee-b80b-0e0abf6f30af tempest-TestServerVolumeAttachmentScenario-619321659 None] Terminate volume connection completed successfully.
Sep 08 16:48:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-3bf624a4-f67a-4649-8276-923cf0f66687 req-99f5915b-a16f-4fee-b80b-0e0abf6f30af tempest-TestServerVolumeAttachmentScenario-619321659 None] Deleting attachment 2806d69c-3f98-4d9b-88f8-fc3b00f6a091. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:48:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-386c9645-ce14-484e-9df9-79d1201455de req-c23cc9d2-c2a8-47ad-b62d-ddbb7e165ab0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Terminate volume connection completed successfully.
Sep 08 16:48:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-386c9645-ce14-484e-9df9-79d1201455de req-c23cc9d2-c2a8-47ad-b62d-ddbb7e165ab0 tempest-TestServerVolumeAttachmentScenario-619321659 None] Deleting attachment 37364723-dad7-4651-b1a0-ab281334d998. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "cinder-7debbd0d-5de4-4a31-991f-4c34f2bf49ee-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-7debbd0d-5de4-4a31-991f-4c34f2bf49ee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "cinder-quobyte-7debbd0d-5de4-4a31-991f-4c34f2bf49ee" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-quobyte-7debbd0d-5de4-4a31-991f-4c34f2bf49ee" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc6cdfe-5e13-402d-ae6e-4eefc936932e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:48:30 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee
Sep 08 16:48:30 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:48:30 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee" returned: 0 in 0.371s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:48:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:48:30 devstack sudo[103410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee
Sep 08 16:48:30 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:48:31 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7debbd0d-5de4-4a31-991f-4c34f2bf49ee" returned: 0 in 0.243s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-quobyte-7debbd0d-5de4-4a31-991f-4c34f2bf49ee" released by "delete_volume" :: held 0.652s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Created reservations ['c0955029-245c-49e7-b210-648f422e0c82', '8aea33f8-ad61-48e0-8fd8-57ea5e725452', 'c63d7e6e-62d6-44d7-8fa9-bb88715db300', '2d4079bf-98e2-42a0-87bf-b7a7773a5cb7'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:48:31 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:48:31 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:48:31 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.241s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:48:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Deleted volume successfully.
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8179f344-e0bf-445b-99c8-f247080ffa44 tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-7debbd0d-5de4-4a31-991f-4c34f2bf49ee-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "cinder-1342e6bd-0555-4919-8807-8832a1ada971-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-1342e6bd-0555-4919-8807-8832a1ada971-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "cinder-quobyte-1342e6bd-0555-4919-8807-8832a1ada971" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-quobyte-1342e6bd-0555-4919-8807-8832a1ada971" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de15cbf-38d5-418c-a69f-a8e9ae6444d1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:48:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:48:31 devstack sudo[103417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971
Sep 08 16:48:31 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:48:32 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971" returned: 0 in 0.351s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:48:32 devstack sudo[103422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971
Sep 08 16:48:32 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:48:32 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1342e6bd-0555-4919-8807-8832a1ada971" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-quobyte-1342e6bd-0555-4919-8807-8832a1ada971" released by "delete_volume" :: held 0.621s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Created reservations ['8d0dbd03-963d-4c9e-bd7f-520bf3191ab5', '269a4ade-d1c0-4e3d-aaa2-9349f3232289', 'ff16feaa-a493-4a3f-bd13-60fbcb8e0716', 'ff7716b4-e918-435e-89f4-b81559dfca80'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:48:32 devstack sudo[103425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:48:32 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:48:32 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:48:32 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Deleted volume successfully.
Sep 08 16:48:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-146124ef-5ec8-4a26-9079-f25bafe16edd tempest-TestServerVolumeAttachmentScenario-619321659 None] Lock "cinder-1342e6bd-0555-4919-8807-8832a1ada971-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:48:42 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:48:42 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:48:56 devstack sudo[103438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:48:56 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:48:56 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:48:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Flow 'volume_create_manager' (fd9b1135-9fad-4ffc-91a5-5fed7777220b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e30f30-4b99-47da-aa21-fbe9e17fa4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e30f30-4b99-47da-aa21-fbe9e17fa4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1274462196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea271637-842a-427a-accc-10ed64dd2524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a28485d85c54e9dafa1a087258e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:49:07Z,use_quota=True,user_id='5409a97f2a8243f8bb1bfb7725f5e6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9c0601-36d7-439f-b2a3-73f082d483a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9c0601-36d7-439f-b2a3-73f082d483a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4356c4d3-4df5-4fbb-b9ea-287005b078b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:49:06 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4356c4d3-4df5-4fbb-b9ea-287005b078b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea271637-842a-427a-accc-10ed64dd2524', 'volume_name': 'volume-ea271637-842a-427a-accc-10ed64dd2524', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440a3cb60>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0c5eef-48e8-43a6-b130-ed6f5eed789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0c5eef-48e8-43a6-b130-ed6f5eed789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b412c-5ca3-4bb7-a044-e2b83141131f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:49:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Volume ea271637-842a-427a-accc-10ed64dd2524: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea271637-842a-427a-accc-10ed64dd2524', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440a3cb60>}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Trying to clone ea271637-842a-427a-accc-10ed64dd2524 from image 9bf04763-a04a-46d0-817b-b7085cff6448 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:49:07 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Image download 20.69 MB at 20.69 MB/s
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bdfc1e-5a97-4f10-8c67-daa1d5ee4aa6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:07 devstack sudo[103479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD
Sep 08 16:49:07 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:07 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 is fetched for user 5409a97f2a8243f8bb1bfb7725f5e6cf. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0144fce7-59b4-487c-a9f0-d29406953aad]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:49:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:07 devstack sudo[103484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD
Sep 08 16:49:07 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:08 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1274462196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea271637-842a-427a-accc-10ed64dd2524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a28485d85c54e9dafa1a087258e944e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:49:07Z,use_quota=True,user_id='5409a97f2a8243f8bb1bfb7725f5e6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Creating volume ea271637-842a-427a-accc-10ed64dd2524 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:49:08 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:08 devstack sudo[103489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 1073741824
Sep 08 16:49:08 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:08 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 1073741824" returned: 0 in 0.387s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:08 devstack sudo[103494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524
Sep 08 16:49:08 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:08 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524" returned: 0 in 0.243s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Attempting download of 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume ea271637-842a-427a-accc-10ed64dd2524. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a624d9b2-618c-49fc-a6ac-79768dc12cc4]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:49:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_10o32wu6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:08 devstack sudo[103503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_10o32wu6
Sep 08 16:49:08 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:09 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_10o32wu6" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_10o32wu6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:09 devstack sudo[103507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_10o32wu6
Sep 08 16:49:09 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:09 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_10o32wu6" returned: 1 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bf04763-a04a-46d0-817b-b7085cff6448_10o32wu6' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f783b6b0-a948-423b-9546-5fabcb612d97]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:09 devstack sudo[103511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD
Sep 08 16:49:09 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:09 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] 9bf04763-a04a-46d0-817b-b7085cff6448 was qcow2, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:49:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:09 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524
Sep 08 16:49:09 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:11 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524" returned: 0 in 1.588s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bf04763-a04a-46d0-817b-b7085cff6448_7v_s481pdevstack@QuobyteHD, size 112.00 MB, duration 1.59 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:49:11 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Converted 112.00 MB image at 70.47 MB/s
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:11 devstack sudo[103525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 1G
Sep 08 16:49:11 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:11 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 1G" returned: 0 in 0.297s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Downloaded image 9bf04763-a04a-46d0-817b-b7085cff6448 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}])) to volume ea271637-842a-427a-accc-10ed64dd2524 successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Temporary image 9bf04763-a04a-46d0-817b-b7085cff6448 for user 5409a97f2a8243f8bb1bfb7725f5e6cf is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Marking volume ea271637-842a-427a-accc-10ed64dd2524 as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Copying metadata from image 9bf04763-a04a-46d0-817b-b7085cff6448 to ea271637-842a-427a-accc-10ed64dd2524. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Creating volume glance metadata for volume ea271637-842a-427a-accc-10ed64dd2524 backed by image 9bf04763-a04a-46d0-817b-b7085cff6448 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b412c-5ca3-4bb7-a044-e2b83141131f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea271637-842a-427a-accc-10ed64dd2524', 'volume_size': 1, 'image_id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bf04763-a04a-46d0-817b-b7085cff6448', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'de506be21de84fb8b3058e18b575baac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9bf04763-a04a-46d0-817b-b7085cff6448', 'created_at': datetime.datetime(2026, 9, 8, 14, 25, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bf04763-a04a-46d0-817b-b7085cff6448/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a3440a3cb60>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ad366-9030-432f-91e0-c5e0d9e8b524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:49:11 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Volume volume-ea271637-842a-427a-accc-10ed64dd2524 (ea271637-842a-427a-accc-10ed64dd2524): created successfully
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228ad366-9030-432f-91e0-c5e0d9e8b524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:49:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Flow 'volume_create_manager' (fd9b1135-9fad-4ffc-91a5-5fed7777220b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:49:11 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0424ca1a-c91f-4955-85e0-5190dfd40acd tempest-TestShelveInstance-806815501 None] Created volume successfully.
Sep 08 16:49:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0fa6d3d3-e588-42cf-947e-42e565fc814b req-cfa815b8-65f2-424f-abfe-e7902819d9a8 tempest-TestShelveInstance-806815501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:49:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0fa6d3d3-e588-42cf-947e-42e565fc814b req-cfa815b8-65f2-424f-abfe-e7902819d9a8 tempest-TestShelveInstance-806815501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:49:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-0fa6d3d3-e588-42cf-947e-42e565fc814b req-cfa815b8-65f2-424f-abfe-e7902819d9a8 tempest-TestShelveInstance-806815501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:49:14 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-0fa6d3d3-e588-42cf-947e-42e565fc814b req-cfa815b8-65f2-424f-abfe-e7902819d9a8 tempest-TestShelveInstance-806815501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-ea271637-842a-427a-accc-10ed64dd2524', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b643b96-4d29-4393-8b1b-e077352844f2', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:49:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-0fa6d3d3-e588-42cf-947e-42e565fc814b req-cfa815b8-65f2-424f-abfe-e7902819d9a8 tempest-TestShelveInstance-806815501 None] attachment_update completed successfully.
Sep 08 16:49:24 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14,cinder:INSERT=11 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:49:24 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=18,cinder:UPDATE=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:49:44 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-25eba82e-a671-4085-a17f-3dfcd93220d3 req-966c5bcc-faaf-426c-8c4b-7cabba08d0bf tempest-TestShelveInstance-806815501 None] Terminate volume connection completed successfully.
Sep 08 16:49:44 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-25eba82e-a671-4085-a17f-3dfcd93220d3 req-966c5bcc-faaf-426c-8c4b-7cabba08d0bf tempest-TestShelveInstance-806815501 None] Deleting attachment 0b643b96-4d29-4393-8b1b-e077352844f2. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:49:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-9526daf0-2800-4e36-981b-9babb70ac2e9 req-4c7afe5e-5f6d-40fa-9a18-af8732e3f77a tempest-TestShelveInstance-806815501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:49:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-9526daf0-2800-4e36-981b-9babb70ac2e9 req-4c7afe5e-5f6d-40fa-9a18-af8732e3f77a tempest-TestShelveInstance-806815501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:49:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-9526daf0-2800-4e36-981b-9babb70ac2e9 req-4c7afe5e-5f6d-40fa-9a18-af8732e3f77a tempest-TestShelveInstance-806815501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:49:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-9526daf0-2800-4e36-981b-9babb70ac2e9 req-4c7afe5e-5f6d-40fa-9a18-af8732e3f77a tempest-TestShelveInstance-806815501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-ea271637-842a-427a-accc-10ed64dd2524', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0392946f-7567-4456-8c08-923345270b79', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:49:46 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-9526daf0-2800-4e36-981b-9babb70ac2e9 req-4c7afe5e-5f6d-40fa-9a18-af8732e3f77a tempest-TestShelveInstance-806815501 None] attachment_update completed successfully.
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:49:56 devstack sudo[104536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:49:56 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:49:56 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.238s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:49:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:50:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-24c38744-67cf-4a35-b19f-cd73a8d7581e tempest-TestShelveInstance-806815501 None] Terminate volume connection completed successfully.
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-24c38744-67cf-4a35-b19f-cd73a8d7581e tempest-TestShelveInstance-806815501 None] Deleting attachment 0392946f-7567-4456-8c08-923345270b79. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Acquiring lock "cinder-ea271637-842a-427a-accc-10ed64dd2524-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Lock "cinder-ea271637-842a-427a-accc-10ed64dd2524-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Acquiring lock "cinder-quobyte-ea271637-842a-427a-accc-10ed64dd2524" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Lock "cinder-quobyte-ea271637-842a-427a-accc-10ed64dd2524" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf6f42c-d0f6-42c8-a767-92ba9b513df9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:50:16 devstack sudo[104643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524
Sep 08 16:50:16 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:50:16 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524" returned: 0 in 0.416s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:50:16 devstack sudo[104648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524
Sep 08 16:50:16 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:50:16 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ea271637-842a-427a-accc-10ed64dd2524" returned: 0 in 0.262s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:50:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Lock "cinder-quobyte-ea271637-842a-427a-accc-10ed64dd2524" released by "delete_volume" :: held 0.724s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG cinder.quota [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Created reservations ['4d7b7312-9677-4f4a-aa5f-2a82c71a3198', '723177f8-f525-4898-8f81-bf1c367681e1', 'd18f6d92-6d48-4db3-8abd-252cbc673e52', '72836951-1081-473d-8e89-0c276a7f6ac6'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:50:17 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:50:17 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:50:17 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG cinder.manager [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:50:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Deleted volume successfully.
Sep 08 16:50:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [req-152ca844-0985-4193-b4b7-8906aadc7c4a req-fed87c5c-c75c-479f-bf4f-6b7f02d0db69 tempest-TestShelveInstance-806815501 None] Lock "cinder-ea271637-842a-427a-accc-10ed64dd2524-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:50:27 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:50:27 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:50:41 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:50:41 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Flow 'volume_create_manager' (7b995f4c-b1cc-4e60-9f66-7d6bffdea744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d35df2-663b-4932-b6f3-8d21f93cb29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d35df2-663b-4932-b6f3-8d21f93cb29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1638131172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301e4a38-e67e-4b45-97de-efbb9c3555cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb005074e51740c99c0a515277d34a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:50:49Z,use_quota=True,user_id='0bcfe7bfcbd7426bbdff3706318d3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9438dfd8-3c63-4db6-a2cb-1882e181f5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9438dfd8-3c63-4db6-a2cb-1882e181f5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577649ae-5d64-48a0-bd38-7a5fcfa1e2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577649ae-5d64-48a0-bd38-7a5fcfa1e2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301e4a38-e67e-4b45-97de-efbb9c3555cc', 'volume_name': 'volume-301e4a38-e67e-4b45-97de-efbb9c3555cc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410e9b64-c4f6-4353-bd06-795d500d2610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (410e9b64-c4f6-4353-bd06-795d500d2610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6abf6f-d1b2-42d1-9f43-a3a97b012e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:50:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Volume 301e4a38-e67e-4b45-97de-efbb9c3555cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301e4a38-e67e-4b45-97de-efbb9c3555cc', 'volume_size': 1}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1638131172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301e4a38-e67e-4b45-97de-efbb9c3555cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb005074e51740c99c0a515277d34a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:50:49Z,use_quota=True,user_id='0bcfe7bfcbd7426bbdff3706318d3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Creating volume 301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:50:48 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:50:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:50:48 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc 1073741824
Sep 08 16:50:48 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:50:49 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc 1073741824" returned: 0 in 0.461s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:50:49 devstack sudo[104673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc
Sep 08 16:50:49 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:50:49 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc" returned: 0 in 0.271s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6abf6f-d1b2-42d1-9f43-a3a97b012e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301e4a38-e67e-4b45-97de-efbb9c3555cc', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b595a0a-4468-457e-a6e7-4f12bce1fc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:50:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Volume volume-301e4a38-e67e-4b45-97de-efbb9c3555cc (301e4a38-e67e-4b45-97de-efbb9c3555cc): created successfully
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b595a0a-4468-457e-a6e7-4f12bce1fc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:50:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Flow 'volume_create_manager' (7b995f4c-b1cc-4e60-9f66-7d6bffdea744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:50:49 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-97d18f5e-4c04-4350-8ac8-c6afd53d1d4a tempest-TestStampPattern-389043435 None] Created volume successfully.
Sep 08 16:50:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:50:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:50:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:50:59 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:50:59 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:51:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-cae979d5-8499-49e2-a229-a1a064e0a7be req-ac59a6e2-3941-4101-b928-a13867dabb79 tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:51:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-cae979d5-8499-49e2-a229-a1a064e0a7be req-ac59a6e2-3941-4101-b928-a13867dabb79 tempest-TestStampPattern-389043435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:51:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-cae979d5-8499-49e2-a229-a1a064e0a7be req-ac59a6e2-3941-4101-b928-a13867dabb79 tempest-TestStampPattern-389043435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:51:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-cae979d5-8499-49e2-a229-a1a064e0a7be req-ac59a6e2-3941-4101-b928-a13867dabb79 tempest-TestStampPattern-389043435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-301e4a38-e67e-4b45-97de-efbb9c3555cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcce8428-cf14-4531-9921-62398e001254', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:51:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-cae979d5-8499-49e2-a229-a1a064e0a7be req-ac59a6e2-3941-4101-b928-a13867dabb79 tempest-TestStampPattern-389043435 None] attachment_update completed successfully.
Sep 08 16:51:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-99f7f182-87a9-4ff3-825c-cd95a6ff65d8 req-48c857b9-ce7b-421c-8880-77256bafb485 tempest-TestStampPattern-389043435 None] Terminate volume connection completed successfully.
Sep 08 16:51:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-99f7f182-87a9-4ff3-825c-cd95a6ff65d8 req-48c857b9-ce7b-421c-8880-77256bafb485 tempest-TestStampPattern-389043435 None] Deleting attachment dcce8428-cf14-4531-9921-62398e001254. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:51:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:51:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:51:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Creating offline snapshot 93d77d69-d9b1-40bd-a254-7552bcfdf627 of volume 301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:51:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36453ff-1618-4199-b898-a4745828f400]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:51:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:24 devstack sudo[105279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc
Sep 08 16:51:24 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:24 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc" returned: 0 in 0.368s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:24 devstack sudo[105284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 1G
Sep 08 16:51:24 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:24 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 1G" returned: 0 in 0.397s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301e4a38-e67e-4b45-97de-efbb9c3555cc -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:24 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301e4a38-e67e-4b45-97de-efbb9c3555cc -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627
Sep 08 16:51:24 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:24 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301e4a38-e67e-4b45-97de-efbb9c3555cc -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627" returned: 0 in 0.291s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:24 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 is being set with open permissions: ugo+rw
Sep 08 16:51:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:25 devstack sudo[105294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627
Sep 08 16:51:25 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:25 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:25 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.info
Sep 08 16:51:25 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:25 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.info" returned: 0 in 0.254s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:25 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.info is being set with open permissions: ugo+rw
Sep 08 16:51:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:25 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.info
Sep 08 16:51:25 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:25 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.info" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:51:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-457b2951-2d58-44be-a1cb-884c18febabe tempest-TestStampPattern-389043435 None] Create snapshot completed successfully
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Flow 'volume_create_manager' (ee34e547-962a-41f5-ad18-f77e217d896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1070e645-3b73-43fb-a897-da915932ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1070e645-3b73-43fb-a897-da915932ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-123363792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd38ad5a-7cab-4131-8b48-279845dc5fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb005074e51740c99c0a515277d34a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93d77d69-d9b1-40bd-a254-7552bcfdf627,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:51:33Z,use_quota=True,user_id='0bcfe7bfcbd7426bbdff3706318d3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757d1883-c713-404e-ad22-8168c8d9a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757d1883-c713-404e-ad22-8168c8d9a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c41360-d5fe-48b3-8c1f-1e502eef3ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c41360-d5fe-48b3-8c1f-1e502eef3ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd38ad5a-7cab-4131-8b48-279845dc5fb4', 'volume_name': 'volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4', 'volume_size': 1, 'snapshot_id': '93d77d69-d9b1-40bd-a254-7552bcfdf627'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481681d9-a6ef-42b2-b75f-9bc86e747f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481681d9-a6ef-42b2-b75f-9bc86e747f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8565be30-9a1a-495d-b26c-2e9e11e0f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:51:32 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Volume dd38ad5a-7cab-4131-8b48-279845dc5fb4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4', 'volume_size': 1, 'snapshot_id': '93d77d69-d9b1-40bd-a254-7552bcfdf627'}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-quobyte-93d77d69-d9b1-40bd-a254-7552bcfdf627-dd38ad5a-7cab-4131-8b48-279845dc5fb4" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-93d77d69-d9b1-40bd-a254-7552bcfdf627-dd38ad5a-7cab-4131-8b48-279845dc5fb4" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Creating volume dd38ad5a-7cab-4131-8b48-279845dc5fb4 from snapshot 93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-quobyte-dd38ad5a-7cab-4131-8b48-279845dc5fb4" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-dd38ad5a-7cab-4131-8b48-279845dc5fb4" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] snapshot: 93d77d69-d9b1-40bd-a254-7552bcfdf627, volume: dd38ad5a-7cab-4131-8b48-279845dc5fb4,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b353d74-381f-4c18-8708-9baf2132fe59]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:51:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:32 devstack sudo[105331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627
Sep 08 16:51:32 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:33 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627" returned: 0 in 0.355s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301e4a38-e67e-4b45-97de-efbb9c3555cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[332e8fba-6c7f-403f-aa23-83983b208dfd]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:33 devstack sudo[105336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc
Sep 08 16:51:33 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:33 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc" returned: 0 in 0.390s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:51:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:33 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4
Sep 08 16:51:33 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:39 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4" returned: 0 in 5.365s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:51:39 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Converted 1024.00 MB image at 190.78 MB/s
Sep 08 16:51:39 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 is being set with open permissions: ugo+rw
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:39 devstack sudo[105363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4
Sep 08 16:51:39 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:39 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4" returned: 0 in 0.298s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-dd38ad5a-7cab-4131-8b48-279845dc5fb4" released by "_copy_volume_from_snapshot" :: held 6.504s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-93d77d69-d9b1-40bd-a254-7552bcfdf627-dd38ad5a-7cab-4131-8b48-279845dc5fb4" released by "_create_volume_from_snapshot" :: held 6.584s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.599s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8565be30-9a1a-495d-b26c-2e9e11e0f027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4', 'volume_size': 1, 'snapshot_id': '93d77d69-d9b1-40bd-a254-7552bcfdf627'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a8edd1-debd-42cf-99c6-02f15ccae1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:51:39 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Volume volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 (dd38ad5a-7cab-4131-8b48-279845dc5fb4): created successfully
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a8edd1-debd-42cf-99c6-02f15ccae1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:51:39 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Flow 'volume_create_manager' (ee34e547-962a-41f5-ad18-f77e217d896a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:51:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a2893d94-7425-442e-b149-c81ed0b05a09 tempest-TestStampPattern-389043435 None] Created volume successfully.
Sep 08 16:51:49 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=11,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:51:49 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:51:56 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:51:56 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:51:56 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:51:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:52:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-62d414f1-32a5-4f19-87d7-99e03fee15d2 req-809f7697-fe1b-4326-905b-d3f49d5f7f48 tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-62d414f1-32a5-4f19-87d7-99e03fee15d2 req-809f7697-fe1b-4326-905b-d3f49d5f7f48 tempest-TestStampPattern-389043435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [req-62d414f1-32a5-4f19-87d7-99e03fee15d2 req-809f7697-fe1b-4326-905b-d3f49d5f7f48 tempest-TestStampPattern-389043435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-62d414f1-32a5-4f19-87d7-99e03fee15d2 req-809f7697-fe1b-4326-905b-d3f49d5f7f48 tempest-TestStampPattern-389043435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444', 'name': 'volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '668df0bd-37bc-4a17-8385-b52766de79e5', 'enforce_multipath': True} {{(pid=87505) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 08 16:52:08 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-62d414f1-32a5-4f19-87d7-99e03fee15d2 req-809f7697-fe1b-4326-905b-d3f49d5f7f48 tempest-TestStampPattern-389043435 None] attachment_update completed successfully.
Sep 08 16:52:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [req-d5cc289f-584c-41bb-aff6-6820d81dde17 req-0ccfa8fd-a3df-496e-97a6-04d6b59413b2 tempest-TestStampPattern-389043435 None] Terminate volume connection completed successfully.
Sep 08 16:52:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [req-d5cc289f-584c-41bb-aff6-6820d81dde17 req-0ccfa8fd-a3df-496e-97a6-04d6b59413b2 tempest-TestStampPattern-389043435 None] Deleting attachment 668df0bd-37bc-4a17-8385-b52766de79e5. {{(pid=87505) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 08 16:52:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-dd38ad5a-7cab-4131-8b48-279845dc5fb4-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Lock "cinder-dd38ad5a-7cab-4131-8b48-279845dc5fb4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-quobyte-dd38ad5a-7cab-4131-8b48-279845dc5fb4" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-dd38ad5a-7cab-4131-8b48-279845dc5fb4" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:14 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84b6ace-b29c-41f3-be51-e6357fdebf5e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:14 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4
Sep 08 16:52:14 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:15 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:15 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4
Sep 08 16:52:15 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:15 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dd38ad5a-7cab-4131-8b48-279845dc5fb4" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-dd38ad5a-7cab-4131-8b48-279845dc5fb4" released by "delete_volume" :: held 0.611s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Created reservations ['951e9428-6b8e-4577-b0d0-3294d4cf5921', '6e5d096e-5cd0-4f05-84ef-a77f4c401622', '0d65cbe7-544d-4618-8b80-eac8a8ec65ec', 'abbfed05-53f6-49df-84ed-80a5534c9c1b'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:15 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:52:15 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:15 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.238s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:52:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Deleted volume successfully.
Sep 08 16:52:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ac64f6c7-90f0-435e-8ec3-b5214b8ec757 tempest-TestStampPattern-389043435 None] Lock "cinder-dd38ad5a-7cab-4131-8b48-279845dc5fb4-delete_volume" released by "delete_volume" :: held 1.033s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-93d77d69-d9b1-40bd-a254-7552bcfdf627-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Lock "cinder-93d77d69-d9b1-40bd-a254-7552bcfdf627-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-quobyte-301e4a38-e67e-4b45-97de-efbb9c3555cc" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-301e4a38-e67e-4b45-97de-efbb9c3555cc" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-quobyte-93d77d69-d9b1-40bd-a254-7552bcfdf627" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-93d77d69-d9b1-40bd-a254-7552bcfdf627" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Deleting offline snapshot 93d77d69-d9b1-40bd-a254-7552bcfdf627 of volume 301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] snapshot_file for this snap is: volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[830c3b4e-6b59-43c6-9fab-05376998c4ad]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:16 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627
Sep 08 16:52:16 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:16 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627" returned: 0 in 0.362s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301e4a38-e67e-4b45-97de-efbb9c3555cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aea0757-5ec0-4af3-8b87-109babd99c29]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:16 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc
Sep 08 16:52:16 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:17 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc" returned: 0 in 0.522s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:17 devstack sudo[106003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627
Sep 08 16:52:17 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:17 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627" returned: 0 in 0.298s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:17 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627
Sep 08 16:52:17 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:17 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc.93d77d69-d9b1-40bd-a254-7552bcfdf627" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-93d77d69-d9b1-40bd-a254-7552bcfdf627" released by "_delete_snapshot" :: held 1.507s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-301e4a38-e67e-4b45-97de-efbb9c3555cc" released by "delete_snapshot" :: held 1.527s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Created reservations ['af327637-dbff-4d21-9a28-44ac6349029a', '62b271b7-ba7b-41c7-a4fa-a387290f2186', '6ebba449-bd47-46be-816c-e475b5410810', 'b11398ec-17da-48aa-a08c-198a89ff7698'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Delete snapshot completed successfully.
Sep 08 16:52:17 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-64a98476-cc25-49ee-8f92-3c1977378c17 tempest-TestStampPattern-389043435 None] Lock "cinder-93d77d69-d9b1-40bd-a254-7552bcfdf627-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-301e4a38-e67e-4b45-97de-efbb9c3555cc-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Lock "cinder-301e4a38-e67e-4b45-97de-efbb9c3555cc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Acquiring lock "cinder-quobyte-301e4a38-e67e-4b45-97de-efbb9c3555cc" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-301e4a38-e67e-4b45-97de-efbb9c3555cc" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:21 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[bededcc2-c1ea-4af3-8bed-f558ff3a583e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:22 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc
Sep 08 16:52:22 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:22 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc" returned: 0 in 0.347s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:22 devstack sudo[106043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc
Sep 08 16:52:22 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:22 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-301e4a38-e67e-4b45-97de-efbb9c3555cc" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Lock "cinder-quobyte-301e4a38-e67e-4b45-97de-efbb9c3555cc" released by "delete_volume" :: held 0.642s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Created reservations ['2c0fe4c3-ab6c-4c4a-bef8-295620feef12', 'fbd5cf56-8346-4eaf-8e0b-4bcf46e5599e', 'f8a8ea69-88cd-4180-a9f6-d76acce9b5d8', '7870416d-da8f-426d-948f-1bdea1176512'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:22 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:52:22 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:22 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.272s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:22 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:52:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Deleted volume successfully.
Sep 08 16:52:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ecd7d9a4-86d0-427d-b6d7-075b07c554ac tempest-TestStampPattern-389043435 None] Lock "cinder-301e4a38-e67e-4b45-97de-efbb9c3555cc-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Flow 'volume_create_manager' (72edcdb8-5f05-4c78-8694-83db4b6a5821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df1291c-e59b-4f51-a6eb-e9690a4aaaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df1291c-e59b-4f51-a6eb-e9690a4aaaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-452072018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a665d44-03b6-4987-841e-c9bf82866c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6bcef88b75460bbf7fa7ed7eb92dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:52:34Z,use_quota=True,user_id='94251bc1c3744a10bedda3588bc5afb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be426676-3e92-4779-93db-d4922a6faedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be426676-3e92-4779-93db-d4922a6faedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dc3bae-938d-491c-a848-a41d87b91ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dc3bae-938d-491c-a848-a41d87b91ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a665d44-03b6-4987-841e-c9bf82866c27', 'volume_name': 'volume-0a665d44-03b6-4987-841e-c9bf82866c27', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e373ae-c1d0-4e25-bdd7-210586f9f90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e373ae-c1d0-4e25-bdd7-210586f9f90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247ef62c-f703-4484-8961-74e7839a56ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Volume 0a665d44-03b6-4987-841e-c9bf82866c27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a665d44-03b6-4987-841e-c9bf82866c27', 'volume_size': 1}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-452072018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a665d44-03b6-4987-841e-c9bf82866c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6bcef88b75460bbf7fa7ed7eb92dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:52:34Z,use_quota=True,user_id='94251bc1c3744a10bedda3588bc5afb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Creating volume 0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:52:34 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:34 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 1073741824
Sep 08 16:52:34 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:34 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 1073741824" returned: 0 in 0.393s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:34 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27
Sep 08 16:52:34 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:35 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27" returned: 0 in 0.257s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247ef62c-f703-4484-8961-74e7839a56ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a665d44-03b6-4987-841e-c9bf82866c27', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3ebe54-b6cb-46cb-811f-91c7cc01b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Volume volume-0a665d44-03b6-4987-841e-c9bf82866c27 (0a665d44-03b6-4987-841e-c9bf82866c27): created successfully
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3ebe54-b6cb-46cb-811f-91c7cc01b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Flow 'volume_create_manager' (72edcdb8-5f05-4c78-8694-83db4b6a5821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-de6c82e8-5f7c-4ba2-a7b7-d350207ed81f tempest-VolumeDependencyTests-1640864126 None] Created volume successfully.
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Creating offline snapshot b9110f11-c199-42c1-964f-4d32b5472f85 of volume 0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db13af-4384-4ba6-b992-35dd57ccb65a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:35 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27
Sep 08 16:52:35 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:35 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:35 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 1G
Sep 08 16:52:35 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:36 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 1G" returned: 0 in 0.360s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a665d44-03b6-4987-841e-c9bf82866c27 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:36 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a665d44-03b6-4987-841e-c9bf82866c27 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85
Sep 08 16:52:36 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:36 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a665d44-03b6-4987-841e-c9bf82866c27 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85" returned: 0 in 0.271s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:36 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 is being set with open permissions: ugo+rw
Sep 08 16:52:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:36 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85
Sep 08 16:52:36 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:36 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:36 devstack sudo[106085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.info
Sep 08 16:52:36 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:37 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.info" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:37 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.info is being set with open permissions: ugo+rw
Sep 08 16:52:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:37 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.info
Sep 08 16:52:37 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:37 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.info" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.766s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c757c85c-6ab4-48f3-8725-d72441d94216 tempest-VolumeDependencyTests-1640864126 None] Create snapshot completed successfully
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Flow 'volume_create_manager' (97242bb5-33c1-4562-87cb-36ac1f8e70f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98523e7d-c860-4d25-a9d0-ad9b62cfd713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98523e7d-c860-4d25-a9d0-ad9b62cfd713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-979044682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6bcef88b75460bbf7fa7ed7eb92dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b9110f11-c199-42c1-964f-4d32b5472f85,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:52:38Z,use_quota=True,user_id='94251bc1c3744a10bedda3588bc5afb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a035a841-841c-492c-837a-fc036bce52f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a035a841-841c-492c-837a-fc036bce52f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4652e697-9d40-4ae5-8caa-abd6b7873025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4652e697-9d40-4ae5-8caa-abd6b7873025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77', 'volume_name': 'volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77', 'volume_size': 1, 'snapshot_id': 'b9110f11-c199-42c1-964f-4d32b5472f85'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b8652a-b009-4e62-b9f7-588274ed9f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b8652a-b009-4e62-b9f7-588274ed9f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ee57b7-da8d-4501-8342-784b797fd6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:38 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Volume 315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77', 'volume_size': 1, 'snapshot_id': 'b9110f11-c199-42c1-964f-4d32b5472f85'}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-quobyte-b9110f11-c199-42c1-964f-4d32b5472f85-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-b9110f11-c199-42c1-964f-4d32b5472f85-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Creating volume 315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 from snapshot b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-quobyte-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] snapshot: b9110f11-c199-42c1-964f-4d32b5472f85, volume: 315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2225d07f-856d-449d-91ad-647fb17d7820]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:38 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85
Sep 08 16:52:38 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:38 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85" returned: 0 in 0.353s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a665d44-03b6-4987-841e-c9bf82866c27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e468c1-b485-41fa-a87a-c877c1c9a70f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:38 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27
Sep 08 16:52:38 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:39 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27" returned: 0 in 0.348s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:52:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:52:39 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:52:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:39 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77
Sep 08 16:52:39 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:42 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" returned: 0 in 3.881s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:42 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27, size 1024.00 MB, duration 3.88 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:52:42 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Converted 1024.00 MB image at 263.72 MB/s
Sep 08 16:52:42 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 is being set with open permissions: ugo+rw
Sep 08 16:52:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:42 devstack sudo[106114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77
Sep 08 16:52:42 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:43 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" released by "_copy_volume_from_snapshot" :: held 4.885s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-b9110f11-c199-42c1-964f-4d32b5472f85-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" released by "_create_volume_from_snapshot" :: held 4.942s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.956s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ee57b7-da8d-4501-8342-784b797fd6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77', 'volume_size': 1, 'snapshot_id': 'b9110f11-c199-42c1-964f-4d32b5472f85'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5bd65f-6823-4bbc-a179-256a2e6bd869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:43 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Volume volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 (315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77): created successfully
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5bd65f-6823-4bbc-a179-256a2e6bd869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Flow 'volume_create_manager' (97242bb5-33c1-4562-87cb-36ac1f8e70f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:43 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9b669540-426f-42ed-b662-e077ecfe5975 tempest-VolumeDependencyTests-1640864126 None] Created volume successfully.
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-b9110f11-c199-42c1-964f-4d32b5472f85-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-b9110f11-c199-42c1-964f-4d32b5472f85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-quobyte-0a665d44-03b6-4987-841e-c9bf82866c27" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-0a665d44-03b6-4987-841e-c9bf82866c27" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-quobyte-b9110f11-c199-42c1-964f-4d32b5472f85" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-b9110f11-c199-42c1-964f-4d32b5472f85" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Deleting offline snapshot b9110f11-c199-42c1-964f-4d32b5472f85 of volume 0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] snapshot_file for this snap is: volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e9d2cb-87e8-4569-9617-736e1f0e7a23]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:43 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85
Sep 08 16:52:43 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:44 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85" returned: 0 in 0.369s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a665d44-03b6-4987-841e-c9bf82866c27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:52:44 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4253ab91-0165-4147-8c99-9bef242c395d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:44 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27
Sep 08 16:52:44 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:44 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27" returned: 0 in 0.567s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:44 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85
Sep 08 16:52:44 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:45 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85" returned: 0 in 0.313s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:45 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85
Sep 08 16:52:45 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:45 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27.b9110f11-c199-42c1-964f-4d32b5472f85" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-b9110f11-c199-42c1-964f-4d32b5472f85" released by "_delete_snapshot" :: held 1.580s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-0a665d44-03b6-4987-841e-c9bf82866c27" released by "delete_snapshot" :: held 1.603s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Created reservations ['27322546-1706-4e23-b87b-117abc689a77', '4ba35d58-3cc7-4a5f-bfd4-3e68e313cdc1', '2dfc8adf-df2a-4804-a6fe-147950fe25d4', '1817dba0-1cbd-4e4e-b0b2-ab598e7af9cc'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:45 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Delete snapshot completed successfully.
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-20ca3f67-c565-4f89-950b-6260cdb7fe66 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-b9110f11-c199-42c1-964f-4d32b5472f85-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-0a665d44-03b6-4987-841e-c9bf82866c27-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-0a665d44-03b6-4987-841e-c9bf82866c27-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-quobyte-0a665d44-03b6-4987-841e-c9bf82866c27" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-0a665d44-03b6-4987-841e-c9bf82866c27" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde3c5d2-8e30-41cd-9264-5e21f370037e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:46 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27
Sep 08 16:52:46 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:46 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27" returned: 0 in 0.358s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:46 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27
Sep 08 16:52:46 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:46 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-0a665d44-03b6-4987-841e-c9bf82866c27" returned: 0 in 0.235s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-0a665d44-03b6-4987-841e-c9bf82866c27" released by "delete_volume" :: held 0.644s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Created reservations ['bedba6e8-e562-4871-bcf7-958e0b8c355b', 'ad636d60-fe19-4c5c-a408-227eb4e56fae', 'a207b369-822e-41d9-ad8f-5d75fded16ff', 'a1f4214b-4769-4625-893e-c62a74f779bd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:46 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:52:46 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:46 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.234s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:52:46 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Deleted volume successfully.
Sep 08 16:52:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f506b49c-866b-4fae-96b3-3a49025b8bc5 tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-0a665d44-03b6-4987-841e-c9bf82866c27-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "cinder-quobyte-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[284973cd-89fb-4d88-ae34-db76be11a4e3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:47 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77
Sep 08 16:52:47 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:47 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" returned: 0 in 0.341s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:47 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77
Sep 08 16:52:47 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:47 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" returned: 0 in 0.258s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-quobyte-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77" released by "delete_volume" :: held 0.638s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Created reservations ['f6eca837-9d22-4bd5-bf0a-e0d34b68ce6b', 'b2b38ac4-13bb-43d8-a4b7-f9da5a3ca676', '5b068592-757c-4e7f-b1b5-f586230b54f8', 'c10c6ad5-2503-4ba5-b90f-796f4b762304'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:47 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:52:47 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:48 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.264s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:48 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:52:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Deleted volume successfully.
Sep 08 16:52:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-077d25b6-5f79-40fb-8e4c-803247e3e79f tempest-VolumeDependencyTests-1640864126 None] Lock "cinder-315bb9dc-c1c4-4fa2-8a52-23aa2d0abb77-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Flow 'volume_create_manager' (b7be6bb1-ec28-4277-bc79-950ef4521517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5550a9-a61c-40c8-865b-f037155ac7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5550a9-a61c-40c8-865b-f037155ac7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e35f43-d2f9-45bc-954a-583966d32dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7d30eef19f47d793f821062fba3f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:52:51Z,use_quota=True,user_id='3ad63f9a9b874256a2c4215bee017cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e410d8-9fb7-4884-8087-1cbfd03c0152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e410d8-9fb7-4884-8087-1cbfd03c0152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1f85b4-af98-4593-9cb4-ddbab16cd5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1f85b4-af98-4593-9cb4-ddbab16cd5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e35f43-d2f9-45bc-954a-583966d32dce', 'volume_name': 'volume-81e35f43-d2f9-45bc-954a-583966d32dce', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2b75e-c702-4d94-8928-25679c7ddff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd2b75e-c702-4d94-8928-25679c7ddff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4104f26-7b30-481c-9d34-218f438e8027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:50 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Volume 81e35f43-d2f9-45bc-954a-583966d32dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e35f43-d2f9-45bc-954a-583966d32dce', 'volume_size': 1}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e35f43-d2f9-45bc-954a-583966d32dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7d30eef19f47d793f821062fba3f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:52:51Z,use_quota=True,user_id='3ad63f9a9b874256a2c4215bee017cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Creating volume 81e35f43-d2f9-45bc-954a-583966d32dce {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:52:50 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:52:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:51 devstack sudo[106160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce 1073741824
Sep 08 16:52:51 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:51 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce 1073741824" returned: 0 in 0.381s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:51 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce
Sep 08 16:52:51 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:51 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] <== create_volume: return (651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4104f26-7b30-481c-9d34-218f438e8027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e35f43-d2f9-45bc-954a-583966d32dce', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5d33e9-9f90-46a6-a4b3-44906e867bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:51 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Volume volume-81e35f43-d2f9-45bc-954a-583966d32dce (81e35f43-d2f9-45bc-954a-583966d32dce): created successfully
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5d33e9-9f90-46a6-a4b3-44906e867bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:51 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Flow 'volume_create_manager' (b7be6bb1-ec28-4277-bc79-950ef4521517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:51 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d52cafdc-241c-43f9-9aff-c7507cfa49ef tempest-CinderUnicodeTest-1113737950 None] Created volume successfully.
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Flow 'volume_create_manager' (af44262f-a962-435e-8f25-cc8d43971755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada62327-63d4-45a8-9db0-92012a656ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada62327-63d4-45a8-9db0-92012a656ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:52:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1970618431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f44c5f7-515c-494b-a207-01037ccc60a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7d30eef19f47d793f821062fba3f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:52:52Z,use_quota=True,user_id='3ad63f9a9b874256a2c4215bee017cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2192fdaf-46d2-4d5a-8e00-9a4d0b364386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2192fdaf-46d2-4d5a-8e00-9a4d0b364386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3e56b1-d7a9-467c-96df-455b72e4eadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef3e56b1-d7a9-467c-96df-455b72e4eadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f44c5f7-515c-494b-a207-01037ccc60a1', 'volume_name': 'volume-1f44c5f7-515c-494b-a207-01037ccc60a1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7124c4a-6712-4eae-96aa-bfac71c558fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7124c4a-6712-4eae-96aa-bfac71c558fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3680ce84-0d56-4f8a-8562-ef1de15e3354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:52 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Volume 1f44c5f7-515c-494b-a207-01037ccc60a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f44c5f7-515c-494b-a207-01037ccc60a1', 'volume_size': 1}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:52:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1970618431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f44c5f7-515c-494b-a207-01037ccc60a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7d30eef19f47d793f821062fba3f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:52:52Z,use_quota=True,user_id='3ad63f9a9b874256a2c4215bee017cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Creating volume 1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:52:52 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:52 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 1073741824
Sep 08 16:52:52 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:52 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 1073741824" returned: 0 in 0.380s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:52 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1
Sep 08 16:52:52 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:53 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1" returned: 0 in 0.230s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] <== create_volume: return (647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3680ce84-0d56-4f8a-8562-ef1de15e3354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f44c5f7-515c-494b-a207-01037ccc60a1', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba080a82-a729-40b4-b09f-47a771b588e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:52:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Volume volume-1f44c5f7-515c-494b-a207-01037ccc60a1 (1f44c5f7-515c-494b-a207-01037ccc60a1): created successfully
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba080a82-a729-40b4-b09f-47a771b588e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Flow 'volume_create_manager' (af44262f-a962-435e-8f25-cc8d43971755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:52:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e2e66dcd-fe61-48b3-b89d-7c919441147e tempest-CinderUnicodeTest-1113737950 None] Created volume successfully.
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Creating offline snapshot 8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c of volume 1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fdab8d-b6e3-496c-bebe-e403f68a6234]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:53 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1
Sep 08 16:52:53 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:54 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1" returned: 0 in 0.340s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:54 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c 1G
Sep 08 16:52:54 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:54 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c 1G" returned: 0 in 0.351s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f44c5f7-515c-494b-a207-01037ccc60a1 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:54 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f44c5f7-515c-494b-a207-01037ccc60a1 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c
Sep 08 16:52:54 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:54 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f44c5f7-515c-494b-a207-01037ccc60a1 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" returned: 0 in 0.277s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:54 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c is being set with open permissions: ugo+rw
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:54 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c
Sep 08 16:52:54 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:54 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" returned: 0 in 0.232s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:54 devstack sudo[106198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.info
Sep 08 16:52:54 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:55 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.info" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:55 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.info is being set with open permissions: ugo+rw
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:55 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.info
Sep 08 16:52:55 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:55 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.info" returned: 0 in 0.225s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.734s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:55 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-13b6749a-fd9c-42fe-9aff-0b46b705342e tempest-CinderUnicodeTest-1113737950 None] Create snapshot completed successfully
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "cinder-8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "cinder-quobyte-1f44c5f7-515c-494b-a207-01037ccc60a1" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-1f44c5f7-515c-494b-a207-01037ccc60a1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "cinder-quobyte-8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Deleting offline snapshot 8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c of volume 1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] snapshot_file for this snap is: volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b8a56-a8ba-4ed9-8913-4951e7ab17c2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:55 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c
Sep 08 16:52:55 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:56 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f44c5f7-515c-494b-a207-01037ccc60a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b962590f-55ec-44a2-9ec3-96f282e15f7e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:56 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1
Sep 08 16:52:56 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:56 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1" returned: 0 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:56 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c
Sep 08 16:52:56 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:56 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:52:56 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:56 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:52:56 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" returned: 0 in 0.325s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:56 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c
Sep 08 16:52:56 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:57 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1.8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" returned: 0 in 0.230s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c" released by "_delete_snapshot" :: held 1.314s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-1f44c5f7-515c-494b-a207-01037ccc60a1" released by "delete_snapshot" :: held 1.335s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:57 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Created reservations ['4b962944-0aca-44da-9172-c84a0ef44548', '1460fd7d-b7f7-4bb5-95e0-3d3ac66884c4', 'bd61b4c4-3900-4195-b5f5-aad36c9f76f1', '74e38576-9cbc-45e9-a4eb-e373739edcfd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Delete snapshot completed successfully.
Sep 08 16:52:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-dcdd2b1b-be35-40ee-9a47-59bdae318f9d tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-8a8fc17d-7690-4344-ac9a-ed9ec7afbf7c-delete_snapshot" released by "delete_snapshot" :: held 1.453s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "cinder-1f44c5f7-515c-494b-a207-01037ccc60a1-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-1f44c5f7-515c-494b-a207-01037ccc60a1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "cinder-quobyte-1f44c5f7-515c-494b-a207-01037ccc60a1" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-1f44c5f7-515c-494b-a207-01037ccc60a1" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9481b5-28cf-463e-9657-b948d04258a8]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:58 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1
Sep 08 16:52:58 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:58 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:58 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1
Sep 08 16:52:58 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:58 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1f44c5f7-515c-494b-a207-01037ccc60a1" returned: 0 in 0.224s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-1f44c5f7-515c-494b-a207-01037ccc60a1" released by "delete_volume" :: held 0.608s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Created reservations ['d9a8efc1-cae5-4b17-9300-6fdea0442512', 'eccbcd8a-bce0-445a-a7c7-9364e5cc8913', '49c08ea9-5d57-4231-be87-5fa76420bf99', '411cc1c0-4997-48ab-b7df-fc67e2f52dce'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:58 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:52:58 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:58 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.244s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:58 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:52:58 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Deleted volume successfully.
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5d2c49c2-46a0-4b0a-a1c6-a81ec9ec1899 tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-1f44c5f7-515c-494b-a207-01037ccc60a1-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "cinder-81e35f43-d2f9-45bc-954a-583966d32dce-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-81e35f43-d2f9-45bc-954a-583966d32dce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "cinder-quobyte-81e35f43-d2f9-45bc-954a-583966d32dce" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-81e35f43-d2f9-45bc-954a-583966d32dce" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[266d45cb-c84f-46c5-b8c3-82ac9477f7cb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:59 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce
Sep 08 16:52:59 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:59 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:59 devstack sudo[106279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce
Sep 08 16:52:59 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:52:59 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81e35f43-d2f9-45bc-954a-583966d32dce" returned: 0 in 0.234s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-quobyte-81e35f43-d2f9-45bc-954a-583966d32dce" released by "delete_volume" :: held 0.616s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=67,cinder:UPDATE=73,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=69,cinder:UPDATE=75,cinder:INSERT=17,cinder:DELETE=6 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Created reservations ['df6b8532-8076-40d7-8447-2a2d0905708f', 'bd5a1d82-2038-4059-aded-953e028a3d44', '26c0300d-4651-4895-bea1-4358323a0075', '6bb346d7-6dfe-4d83-830e-25b5bd9bdfbd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:52:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:52:59 devstack sudo[106282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:52:59 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:00 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:00 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Deleted volume successfully.
Sep 08 16:53:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9771e66c-39be-4826-9ee6-ad2eef918bfd tempest-CinderUnicodeTest-1113737950 None] Lock "cinder-81e35f43-d2f9-45bc-954a-583966d32dce-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:09 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:53:10 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:INSERT=2,cinder:UPDATE=6,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (e77669ed-b534-43c7-93b6-0acaa3006e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8652378b-b6ce-4a5d-a26f-40545dd94fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8652378b-b6ce-4a5d-a26f-40545dd94fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203733845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e67c72e-e439-49f1-b2a8-d13c93891208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:16Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a1eb2d-8af5-49ca-aa2b-f95f9bde3386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a1eb2d-8af5-49ca-aa2b-f95f9bde3386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2c78cf-4c3b-4c3d-9cf0-82eef8d702ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2c78cf-4c3b-4c3d-9cf0-82eef8d702ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e67c72e-e439-49f1-b2a8-d13c93891208', 'volume_name': 'volume-2e67c72e-e439-49f1-b2a8-d13c93891208', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c259fddd-0142-4329-a1dc-e3a7196119c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c259fddd-0142-4329-a1dc-e3a7196119c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fccf672-7e6c-47ba-a7d2-2ad93bb2b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume 2e67c72e-e439-49f1-b2a8-d13c93891208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e67c72e-e439-49f1-b2a8-d13c93891208', 'volume_size': 1}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203733845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e67c72e-e439-49f1-b2a8-d13c93891208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:16Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Creating volume 2e67c72e-e439-49f1-b2a8-d13c93891208 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:16 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:16 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208 1073741824
Sep 08 16:53:16 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (64595a77-d5fb-448f-9ab8-c58bed75acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf99e29-c379-4c6d-8824-5f9d4833fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf99e29-c379-4c6d-8824-5f9d4833fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1776899738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aee2bbc-c1d7-44b9-978e-61c8369b1bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:16Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998af05c-9a8e-4be8-98fe-de3042155f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998af05c-9a8e-4be8-98fe-de3042155f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e34ffb3-59f4-49fa-a87c-a411a61b9b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e34ffb3-59f4-49fa-a87c-a411a61b9b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aee2bbc-c1d7-44b9-978e-61c8369b1bf4', 'volume_name': 'volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169ac67e-2f34-45cf-936c-355728cbb92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169ac67e-2f34-45cf-936c-355728cbb92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742d946d-f1ff-4a2c-a9c6-00c6bccd4f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Volume 9aee2bbc-c1d7-44b9-978e-61c8369b1bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4', 'volume_size': 1}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (73ffacd8-42e8-45f7-8dc8-357dcea05500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a50e6a6-3c39-46df-8e9b-12d2dc468309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a50e6a6-3c39-46df-8e9b-12d2dc468309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115383432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf83c14-b52f-4c4b-b5e7-046a962ffb3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:17Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8f2f2-ff27-4b61-a02d-01748046c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc8f2f2-ff27-4b61-a02d-01748046c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bec51-3fa9-4a62-9fae-002df41df752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bec51-3fa9-4a62-9fae-002df41df752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf83c14-b52f-4c4b-b5e7-046a962ffb3c', 'volume_name': 'volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f44c374-e618-4b30-b00e-1064cbddc921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f44c374-e618-4b30-b00e-1064cbddc921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246b4eba-3141-46f7-9cfb-ee193c8b02aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Volume dbf83c14-b52f-4c4b-b5e7-046a962ffb3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c', 'volume_size': 1}
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:16 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208 1073741824" returned: 0 in 0.579s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:17 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208
Sep 08 16:53:17 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (d0e84489-ea8f-43f3-8cec-f81ea527a042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72d9ccf-7062-454b-8d91-8f30ea56a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72d9ccf-7062-454b-8d91-8f30ea56a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337842428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842622cc-f396-42ce-8788-348d6d4d52b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:17Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1544ef75-232a-44d4-aa1b-b8e3abb47385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1544ef75-232a-44d4-aa1b-b8e3abb47385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0b6ac2-e84b-480e-a7a7-13eb0626269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0b6ac2-e84b-480e-a7a7-13eb0626269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842622cc-f396-42ce-8788-348d6d4d52b3', 'volume_name': 'volume-842622cc-f396-42ce-8788-348d6d4d52b3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0546f383-00a3-439c-a29c-b1d8edd0fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0546f383-00a3-439c-a29c-b1d8edd0fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d53362c-c30d-42e8-945b-a7f971234b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Volume 842622cc-f396-42ce-8788-348d6d4d52b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842622cc-f396-42ce-8788-348d6d4d52b3', 'volume_size': 1}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:17 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1776899738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aee2bbc-c1d7-44b9-978e-61c8369b1bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:16Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Creating volume 9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:17 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fccf672-7e6c-47ba-a7d2-2ad93bb2b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e67c72e-e439-49f1-b2a8-d13c93891208', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 1073741824
Sep 08 16:53:17 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e95b141-3b45-40ca-9660-a7d6519d0e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume volume-2e67c72e-e439-49f1-b2a8-d13c93891208 (2e67c72e-e439-49f1-b2a8-d13c93891208): created successfully
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e95b141-3b45-40ca-9660-a7d6519d0e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (e77669ed-b534-43c7-93b6-0acaa3006e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-68b1bf3c-427e-453f-b09d-7618333e3755 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created volume successfully.
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (d3e19615-3422-4a29-a73a-5796a30ae360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1eb1bb8-e4db-46be-b34d-9e796a363422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1eb1bb8-e4db-46be-b34d-9e796a363422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351256396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568812f0-51a2-44c0-8de3-3d4a3e7a4200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:18Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338f366b-b9ed-4db4-9e87-7dfddac4bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338f366b-b9ed-4db4-9e87-7dfddac4bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d2574-6158-4cfe-bf38-6bc67c624417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (696d2574-6158-4cfe-bf38-6bc67c624417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568812f0-51a2-44c0-8de3-3d4a3e7a4200', 'volume_name': 'volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacc5e65-418f-480f-bc7a-25710cc6a576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bacc5e65-418f-480f-bc7a-25710cc6a576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2d268f-3758-4369-9a07-c8b140b1abe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:17 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Volume 568812f0-51a2-44c0-8de3-3d4a3e7a4200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200', 'volume_size': 1}
Sep 08 16:53:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:18 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 1073741824" returned: 0 in 0.770s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:18 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4
Sep 08 16:53:18 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Flow 'volume_create_manager' (1a0a1a05-411e-4e9d-a4a5-4760bc97863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff1fa74-0064-42ef-8322-eb5d1e10d023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff1fa74-0064-42ef-8322-eb5d1e10d023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979984164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2f7cc8-cd01-4c0c-96b5-c54d05acd388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93e5a475c284c8f96a0441d884236d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:18Z,use_quota=True,user_id='c70943f2d82b47dd9caa3bd82c0e59d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b5c6c8-ccfe-44ff-ada8-865ca23f0194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b5c6c8-ccfe-44ff-ada8-865ca23f0194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05079f46-51ba-427a-8a27-0ad56c067b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05079f46-51ba-427a-8a27-0ad56c067b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2f7cc8-cd01-4c0c-96b5-c54d05acd388', 'volume_name': 'volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e587b51f-645d-428c-93d1-b008e21959a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e587b51f-645d-428c-93d1-b008e21959a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7dafb9-63f2-471c-aacb-2db88df7c0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Volume 1b2f7cc8-cd01-4c0c-96b5-c54d05acd388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388', 'volume_size': 1}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (f01847a7-6237-4829-83a5-0f3c36ae35d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af3a47f-4523-40ad-b855-a548b2649d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af3a47f-4523-40ad-b855-a548b2649d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571288361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed6990-fb7e-4cc0-b882-b2f3f0f771b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:18Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9143f1db-2298-4214-aff3-68109ac691a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9143f1db-2298-4214-aff3-68109ac691a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac58732c-3926-4d5b-acd5-b04e1b43d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac58732c-3926-4d5b-acd5-b04e1b43d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ed6990-fb7e-4cc0-b882-b2f3f0f771b0', 'volume_name': 'volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5e3f79-0f83-43b7-9211-72e5cf69ec2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e5e3f79-0f83-43b7-9211-72e5cf69ec2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e6eebe-529a-46e1-8f54-997f73fc438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Volume 92ed6990-fb7e-4cc0-b882-b2f3f0f771b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0', 'volume_size': 1}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:18 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4" returned: 0 in 0.278s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.677s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1115383432',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf83c14-b52f-4c4b-b5e7-046a962ffb3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:17Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Creating volume dbf83c14-b52f-4c4b-b5e7-046a962ffb3c {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:18 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:18 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c 1073741824
Sep 08 16:53:18 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742d946d-f1ff-4a2c-a9c6-00c6bccd4f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f0e166-4162-4902-a971-0aefe10ad7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:18 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Volume volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 (9aee2bbc-c1d7-44b9-978e-61c8369b1bf4): created successfully
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f0e166-4162-4902-a971-0aefe10ad7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (64595a77-d5fb-448f-9ab8-c58bed75acd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-cf44713e-4f02-4e55-9632-1f473702c34e tempest-CreateVolumesFromImageTest-488553973 None] Created volume successfully.
Sep 08 16:53:19 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c 1073741824" returned: 0 in 0.590s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (718086b6-7a72-4390-aace-00f4bd29dca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a58891c-bd4e-4b5b-9e3d-a2d0d928d6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a58891c-bd4e-4b5b-9e3d-a2d0d928d6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698859351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7a987c-5be7-4e22-b245-d75db221c4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:19Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e80aab-e96a-4ff4-b352-7c1e12f708aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e80aab-e96a-4ff4-b352-7c1e12f708aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfa388d-c309-419a-86b5-a9ce02abb1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfa388d-c309-419a-86b5-a9ce02abb1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f7a987c-5be7-4e22-b245-d75db221c4f6', 'volume_name': 'volume-4f7a987c-5be7-4e22-b245-d75db221c4f6', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92dcf78-9c53-42de-95e3-f5aea8259982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92dcf78-9c53-42de-95e3-f5aea8259982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f420d4-25cf-46ab-a085-a4071b080c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume 4f7a987c-5be7-4e22-b245-d75db221c4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f7a987c-5be7-4e22-b245-d75db221c4f6', 'volume_size': 1}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:19 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c" returned: 0 in 0.358s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.256s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-337842428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842622cc-f396-42ce-8788-348d6d4d52b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:17Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Creating volume 842622cc-f396-42ce-8788-348d6d4d52b3 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:19 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:19 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3 1073741824
Sep 08 16:53:19 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246b4eba-3141-46f7-9cfb-ee193c8b02aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317abb60-4215-4fdd-be49-50ca350ce5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (a1b3d6ae-619c-458f-b649-33c53ac169c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11aeba99-8e43-4cb2-b9c5-9de1525d07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Volume volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c (dbf83c14-b52f-4c4b-b5e7-046a962ffb3c): created successfully
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317abb60-4215-4fdd-be49-50ca350ce5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (73ffacd8-42e8-45f7-8dc8-357dcea05500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11aeba99-8e43-4cb2-b9c5-9de1525d07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652393503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d682a46c-609c-4961-b75f-6b1047c007f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:20Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0f30ee-80d1-4d15-ae10-1ce1fc0400a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0f30ee-80d1-4d15-ae10-1ce1fc0400a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d58694-43ca-49ae-8320-4b5f158bce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d58694-43ca-49ae-8320-4b5f158bce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd682a46c-609c-4961-b75f-6b1047c007f9', 'volume_name': 'volume-d682a46c-609c-4961-b75f-6b1047c007f9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d37499-c039-46d3-b530-af7012a605fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d37499-c039-46d3-b530-af7012a605fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dca11a-5b6f-4589-a70b-d4dbcf2a2e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:19 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume d682a46c-609c-4961-b75f-6b1047c007f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d682a46c-609c-4961-b75f-6b1047c007f9', 'volume_size': 1}
Sep 08 16:53:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-64f33011-cc3e-44f0-9be7-95b74d091ef6 tempest-CreateVolumesFromImageTest-488553973 None] Created volume successfully.
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (4a0332f0-afa5-4e6f-9aec-928dec24f261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea506cb0-55d1-4d43-b570-c8c0b3708a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea506cb0-55d1-4d43-b570-c8c0b3708a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132159934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0f2244-2ed1-4710-b1d0-96bc2e0854fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:20Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23edff1d-9dce-4525-91e9-3937ea5506f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23edff1d-9dce-4525-91e9-3937ea5506f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fd6c78-04dc-4288-ac4e-eac921028827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84fd6c78-04dc-4288-ac4e-eac921028827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0f2244-2ed1-4710-b1d0-96bc2e0854fa', 'volume_name': 'volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d3464-81de-400b-abba-b3d5caf9c801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d3464-81de-400b-abba-b3d5caf9c801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65bea4b-50c2-4f68-b774-aaf4e0585dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume da0f2244-2ed1-4710-b1d0-96bc2e0854fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa', 'volume_size': 1}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:20 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3 1073741824" returned: 0 in 0.675s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:20 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3
Sep 08 16:53:20 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (62b81cb9-0390-4f9e-a8ba-45e6cd070b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4c3855-e99b-4a70-a2d0-ece1bc6b231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4c3855-e99b-4a70-a2d0-ece1bc6b231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-169610436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7568ef06-610a-4bd1-a270-2314754ec1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:20Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267e0018-f065-4139-8561-8f2856eb92fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267e0018-f065-4139-8561-8f2856eb92fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19d4c9d-b242-4f87-ae45-c32ca0648364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19d4c9d-b242-4f87-ae45-c32ca0648364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7568ef06-610a-4bd1-a270-2314754ec1d9', 'volume_name': 'volume-7568ef06-610a-4bd1-a270-2314754ec1d9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09ec164-8d9e-4077-8e25-89971012ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09ec164-8d9e-4077-8e25-89971012ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ad370e-fc7f-4bfe-a1f3-6420c2cd865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume 7568ef06-610a-4bd1-a270-2314754ec1d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7568ef06-610a-4bd1-a270-2314754ec1d9', 'volume_size': 1}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:20 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.702s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351256396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568812f0-51a2-44c0-8de3-3d4a3e7a4200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:18Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Creating volume 568812f0-51a2-44c0-8de3-3d4a3e7a4200 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:20 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d53362c-c30d-42e8-945b-a7f971234b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842622cc-f396-42ce-8788-348d6d4d52b3', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea5fc64-6927-4462-9cef-92e25bf80ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:20 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200 1073741824
Sep 08 16:53:20 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Volume volume-842622cc-f396-42ce-8788-348d6d4d52b3 (842622cc-f396-42ce-8788-348d6d4d52b3): created successfully
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea5fc64-6927-4462-9cef-92e25bf80ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (d0e84489-ea8f-43f3-8cec-f81ea527a042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-bb07af18-39e9-409a-b2d7-166c4c88a67e tempest-CreateVolumesFromImageTest-488553973 None] Created volume successfully.
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (dd1fe8f6-f8e9-4317-a00e-4e45a29d44f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b498975-a12c-41d0-92fc-0343d62d2e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b498975-a12c-41d0-92fc-0343d62d2e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739993035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f850a4fb-1b75-4ff1-8e33-2b0939f288fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:21Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2f3d90-d284-4e61-8ada-4ff33d3b667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd2f3d90-d284-4e61-8ada-4ff33d3b667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fed064b-616e-4abe-8095-d1ccea7d22c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fed064b-616e-4abe-8095-d1ccea7d22c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f850a4fb-1b75-4ff1-8e33-2b0939f288fb', 'volume_name': 'volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b24f5d-670a-4775-b611-a14e80e11579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b24f5d-670a-4775-b611-a14e80e11579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434e819e-df1f-42e1-9348-31e4dd871e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume f850a4fb-1b75-4ff1-8e33-2b0939f288fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb', 'volume_size': 1}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:21 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200 1073741824" returned: 0 in 0.538s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:21 devstack sudo[106371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200
Sep 08 16:53:21 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:21 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Flow 'volume_create_manager' (7d126096-e448-47bd-81a6-5c25f123b2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572592f7-b537-4161-80d9-57c827e3e9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.175s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-979984164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2f7cc8-cd01-4c0c-96b5-c54d05acd388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93e5a475c284c8f96a0441d884236d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:18Z,use_quota=True,user_id='c70943f2d82b47dd9caa3bd82c0e59d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Creating volume 1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:21 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572592f7-b537-4161-80d9-57c827e3e9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f4a4d9-722a-41bc-9920-ecad6e974bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222a607155b545429eb8daf1984adf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:21Z,use_quota=True,user_id='88adae142df543758129693287740908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0564caed-ed85-4164-87ee-202dc3e7637c),volume_type_id=0564caed-ed85-4164-87ee-202dc3e7637c)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 1073741824
Sep 08 16:53:21 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e1e8e7-6056-44eb-bf68-2d8ddaf9cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e1e8e7-6056-44eb-bf68-2d8ddaf9cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5d040b-f939-4041-a4b4-83ed2d9bddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2d268f-3758-4369-9a07-c8b140b1abe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62450524-b07d-4420-8a1d-e335372175c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Volume volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200 (568812f0-51a2-44c0-8de3-3d4a3e7a4200): created successfully
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62450524-b07d-4420-8a1d-e335372175c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (d3e19615-3422-4a29-a73a-5796a30ae360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a6a1b3d0-d2f9-4eab-a061-b3e00a718a92 tempest-CreateVolumesFromImageTest-488553973 None] Created volume successfully.
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5d040b-f939-4041-a4b4-83ed2d9bddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4f4a4d9-722a-41bc-9920-ecad6e974bba', 'volume_name': 'volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba', 'volume_size': 1, 'image_id': 'b5e5b4bf-9144-42b9-9c0a-14826134f567', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5e5b4bf-9144-42b9-9c0a-14826134f567', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43ffd8a3f86dfa9ef1379ed02d28a171', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '222a607155b545429eb8daf1984adf55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c8dc319f724458ae3014876b8ae0c676c98a36fafa0d2a5763bb8535946070f882e7acaaaf640d2ea635a3fce31587fb3d15f0dd098c0a217bf8b861680155a3', 'id': 'b5e5b4bf-9144-42b9-9c0a-14826134f567', 'created_at': datetime.datetime(2026, 9, 8, 14, 53, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 53, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5e5b4bf-9144-42b9-9c0a-14826134f567/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34364a9100>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f674cc97-ba03-4574-9223-add06f8b116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f674cc97-ba03-4574-9223-add06f8b116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18397e3b-bb24-4b55-b6be-513c6d9f9c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Volume d4f4a4d9-722a-41bc-9920-ecad6e974bba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba', 'volume_size': 1, 'image_id': 'b5e5b4bf-9144-42b9-9c0a-14826134f567', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5e5b4bf-9144-42b9-9c0a-14826134f567', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43ffd8a3f86dfa9ef1379ed02d28a171', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '222a607155b545429eb8daf1984adf55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c8dc319f724458ae3014876b8ae0c676c98a36fafa0d2a5763bb8535946070f882e7acaaaf640d2ea635a3fce31587fb3d15f0dd098c0a217bf8b861680155a3', 'id': 'b5e5b4bf-9144-42b9-9c0a-14826134f567', 'created_at': datetime.datetime(2026, 9, 8, 14, 53, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 53, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5e5b4bf-9144-42b9-9c0a-14826134f567/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34364a9100>}
Sep 08 16:53:21 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Trying to clone d4f4a4d9-722a-41bc-9920-ecad6e974bba from image b5e5b4bf-9144-42b9-9c0a-14826134f567 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5e5b4bf-9144-42b9-9c0a-14826134f567', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:53:22 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Image download 0.00 MB at 0.00 MB/s
Sep 08 16:53:22 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 1073741824" returned: 0 in 0.542s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a1417e-cf35-4d8f-928f-a47ea54d1a87]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:22 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388
Sep 08 16:53:22 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:22 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD
Sep 08 16:53:22 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:22 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388" returned: 0 in 0.243s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.917s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1571288361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed6990-fb7e-4cc0-b882-b2f3f0f771b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0b78cd3e1e42c4bfd6f5e66bcd9d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:18Z,use_quota=True,user_id='c7e29fb40b5b413cbfecbf8bbebb508d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Creating volume 92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:22 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b7dafb9-63f2-471c-aacb-2db88df7c0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38187c48-e613-4bb3-a85c-9945e427abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:22 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 1073741824
Sep 08 16:53:22 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:22 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Volume volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 (1b2f7cc8-cd01-4c0c-96b5-c54d05acd388): created successfully
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38187c48-e613-4bb3-a85c-9945e427abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Flow 'volume_create_manager' (1a0a1a05-411e-4e9d-a4a5-4760bc97863a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:22 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f89f7b8a-f9b8-42e9-bda6-90860f1adc98 tempest-ProjectReaderTests-1839813541 None] Created volume successfully.
Sep 08 16:53:22 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:22 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD
Sep 08 16:53:22 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:22 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Temporary image b5e5b4bf-9144-42b9-9c0a-14826134f567 is fetched for user 88adae142df543758129693287740908. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:53:22 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 1073741824" returned: 0 in 0.468s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:22 devstack sudo[106398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0
Sep 08 16:53:22 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28c495-7276-40c5-b0ea-cb882fc80911]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:23 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD
Sep 08 16:53:23 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:23 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0" returned: 0 in 0.279s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.936s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-698859351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7a987c-5be7-4e22-b245-d75db221c4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:19Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Creating volume 4f7a987c-5be7-4e22-b245-d75db221c4f6 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:23 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e6eebe-529a-46e1-8f54-997f73fc438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f5ed25-0665-4c8c-9d81-0b897a969124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:23 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6 1073741824
Sep 08 16:53:23 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:23 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Volume volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 (92ed6990-fb7e-4cc0-b882-b2f3f0f771b0): created successfully
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f5ed25-0665-4c8c-9d81-0b897a969124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Flow 'volume_create_manager' (f01847a7-6237-4829-83a5-0f3c36ae35d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6939fb1d-880c-4a21-832d-68b05f8fa464 tempest-CreateVolumesFromImageTest-488553973 None] Created volume successfully.
Sep 08 16:53:23 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Acquiring lock "cinder-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Lock "cinder-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Acquiring lock "cinder-quobyte-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Lock "cinder-quobyte-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:23 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD
Sep 08 16:53:23 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[877bd22b-e296-41c8-a038-996e57273aea]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:23 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388
Sep 08 16:53:23 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:23 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6 1073741824" returned: 0 in 0.542s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-quobyte-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:23 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD" returned: 1 in 0.519s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:23 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:23 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c84ede-acdb-4e94-9428-8be45d185f4b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:23 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388" returned: 0 in 0.427s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:23 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388
Sep 08 16:53:23 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:23 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0
Sep 08 16:53:23 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:24 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6" returned: 0 in 0.284s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.269s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1652393503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d682a46c-609c-4961-b75f-6b1047c007f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:20Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Creating volume d682a46c-609c-4961-b75f-6b1047c007f9 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:24 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f420d4-25cf-46ab-a085-a4071b080c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7a987c-5be7-4e22-b245-d75db221c4f6', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:24 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9 1073741824
Sep 08 16:53:24 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4c71b5-445f-4ea4-bbc2-95161f5c8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:24 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume volume-4f7a987c-5be7-4e22-b245-d75db221c4f6 (4f7a987c-5be7-4e22-b245-d75db221c4f6): created successfully
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4c71b5-445f-4ea4-bbc2-95161f5c8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (718086b6-7a72-4390-aace-00f4bd29dca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ecc9754e-bae9-4a2b-9d83-6f95780dc742 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created volume successfully.
Sep 08 16:53:24 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388" returned: 0 in 0.293s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Lock "cinder-quobyte-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388" released by "delete_volume" :: held 0.772s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:24 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0" returned: 0 in 0.406s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:24 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0
Sep 08 16:53:24 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Created reservations ['857ba72b-95ab-4179-9701-fedd0edd529d', '92ca48eb-4e1b-4a83-9111-d8fc1a3c7056', '7eeca93e-b221-497b-a786-de491c2c6001', 'bdf1cc64-24e7-423f-b363-f8318ac4c7d0'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:24 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:24 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:24 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0" returned: 0 in 0.302s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0" released by "delete_volume" :: held 0.762s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:24 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9 1073741824" returned: 0 in 0.512s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Created reservations ['a3286ce3-4aec-4585-b680-9f9a15cb9d92', 'bb8c817d-b9b6-4756-acf2-4a27119fb1df', '880d213f-487c-4959-b6b3-f02de46ead89', '8a2c0223-53b3-4443-a1ab-6d2fd032b898'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:24 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.320s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Deleted volume successfully.
Sep 08 16:53:24 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9
Sep 08 16:53:24 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-172c4c1a-ce89-4170-8d85-1e3af5f5325c tempest-ProjectReaderTests-1839813541 None] Lock "cinder-1b2f7cc8-cd01-4c0c-96b5-c54d05acd388-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:24 devstack sudo[106446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:24 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-568812f0-51a2-44c0-8de3-3d4a3e7a4200-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:24 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-568812f0-51a2-44c0-8de3-3d4a3e7a4200-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-quobyte-568812f0-51a2-44c0-8de3-3d4a3e7a4200" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:25 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9" returned: 0 in 0.386s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-568812f0-51a2-44c0-8de3-3d4a3e7a4200" acquired by "delete_volume" :: waited 0.040s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132159934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0f2244-2ed1-4710-b1d0-96bc2e0854fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:20Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Creating volume da0f2244-2ed1-4710-b1d0-96bc2e0854fa {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:25 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[824895c3-b076-4e4e-be13-c682f7f9a49b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:25 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa 1073741824
Sep 08 16:53:25 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:25 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dca11a-5b6f-4589-a70b-d4dbcf2a2e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d682a46c-609c-4961-b75f-6b1047c007f9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b05c166-ff70-4bb0-986f-27a88cdac06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.435s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:25 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume volume-d682a46c-609c-4961-b75f-6b1047c007f9 (d682a46c-609c-4961-b75f-6b1047c007f9): created successfully
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b05c166-ff70-4bb0-986f-27a88cdac06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (a1b3d6ae-619c-458f-b649-33c53ac169c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Deleted volume successfully.
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Flow 'volume_create_manager' (2bdab74c-e285-4289-84bf-05a0805562df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:25 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200
Sep 08 16:53:25 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ef49e0-d2fb-4e48-bf66-d9b2f9adbdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6102a36b-872e-4261-bd30-f240444cf7f6 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created volume successfully.
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ef49e0-d2fb-4e48-bf66-d9b2f9adbdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1456558856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624ee208-11c1-4678-9e39-f72b2e626503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93e5a475c284c8f96a0441d884236d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:25Z,use_quota=True,user_id='c70943f2d82b47dd9caa3bd82c0e59d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6583cd-b557-4294-9a13-09ce34441b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f6583cd-b557-4294-9a13-09ce34441b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b98e5c-4861-495e-9974-8f5231729423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b98e5c-4861-495e-9974-8f5231729423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '624ee208-11c1-4678-9e39-f72b2e626503', 'volume_name': 'volume-624ee208-11c1-4678-9e39-f72b2e626503', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc340b9a-bb79-48d3-851f-d51b1e505e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc340b9a-bb79-48d3-851f-d51b1e505e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fe43af-6275-4f63-b2db-7d5b58c8f3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:25 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Volume 624ee208-11c1-4678-9e39-f72b2e626503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-624ee208-11c1-4678-9e39-f72b2e626503', 'volume_size': 1}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-88c0a18b-6e92-461e-8831-53c782eae6b5 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-92ed6990-fb7e-4cc0-b882-b2f3f0f771b0-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:25 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200" returned: 0 in 0.410s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:25 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200
Sep 08 16:53:25 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:25 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa 1073741824" returned: 0 in 0.469s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:25 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa
Sep 08 16:53:25 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:25 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-568812f0-51a2-44c0-8de3-3d4a3e7a4200" returned: 0 in 0.244s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-568812f0-51a2-44c0-8de3-3d4a3e7a4200" released by "delete_volume" :: held 0.726s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Created reservations ['5ad2a085-b645-4449-ac0c-a92bd77f37be', 'f0bdd2e2-9fb6-4f14-a734-e69bc0452c1d', 'dac80fa0-03b0-4b60-b2fa-7f44970865ea', '837b0329-859c-4c43-8b82-919b834f9388'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:25 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa" returned: 0 in 0.279s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.368s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-169610436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7568ef06-610a-4bd1-a270-2314754ec1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:20Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Creating volume 7568ef06-610a-4bd1-a270-2314754ec1d9 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:25 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65bea4b-50c2-4f68-b774-aaf4e0585dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:25 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9 1073741824
Sep 08 16:53:25 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57bf6d6-e4c2-4547-b850-5305776b613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:26 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa (da0f2244-2ed1-4710-b1d0-96bc2e0854fa): created successfully
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57bf6d6-e4c2-4547-b850-5305776b613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:26 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (4a0332f0-afa5-4e6f-9aec-928dec24f261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:26 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-575ed4e5-1c59-47d3-89aa-5f91cb81eddb tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created volume successfully.
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-842622cc-f396-42ce-8788-348d6d4d52b3-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-842622cc-f396-42ce-8788-348d6d4d52b3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-quobyte-842622cc-f396-42ce-8788-348d6d4d52b3" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-842622cc-f396-42ce-8788-348d6d4d52b3" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bc1dfd-d5f8-49e2-91e0-ecfe4c8f7d96]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:26 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.340s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Deleted volume successfully.
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-669fbb61-ae07-43e7-9e28-9f177260d899 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-568812f0-51a2-44c0-8de3-3d4a3e7a4200-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:26 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3
Sep 08 16:53:26 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:26 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9 1073741824" returned: 0 in 0.567s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:26 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9
Sep 08 16:53:26 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:26 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3" returned: 0 in 0.401s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:26 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3
Sep 08 16:53:26 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:26 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.684s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-739993035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f850a4fb-1b75-4ff1-8e33-2b0939f288fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b930c21b4c1641c2b46392289b7f4155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:21Z,use_quota=True,user_id='2c2c9d6066314b099dd5d63a0899f65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Creating volume f850a4fb-1b75-4ff1-8e33-2b0939f288fb {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:26 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ad370e-fc7f-4bfe-a1f3-6420c2cd865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7568ef06-610a-4bd1-a270-2314754ec1d9', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:26 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb 1073741824
Sep 08 16:53:26 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3925e0f-ba12-4410-81dc-abb7e5a4b1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:26 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume volume-7568ef06-610a-4bd1-a270-2314754ec1d9 (7568ef06-610a-4bd1-a270-2314754ec1d9): created successfully
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3925e0f-ba12-4410-81dc-abb7e5a4b1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (62b81cb9-0390-4f9e-a8ba-45e6cd070b95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:26 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-34bc128f-8c5b-45d6-a132-6ff31b9b522c tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created volume successfully.
Sep 08 16:53:26 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-842622cc-f396-42ce-8788-348d6d4d52b3" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:26 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-842622cc-f396-42ce-8788-348d6d4d52b3" released by "delete_volume" :: held 0.715s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Created reservations ['a7f6c9e1-364d-43f3-9674-5322a6816472', '4b345df6-91f0-420b-9c89-29bd335c1351', '5b096e78-3c1a-43b5-9822-9731fbb190a0', '1ec3ce7c-b132-40db-a561-3971af741987'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:27 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:27 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:27 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb 1073741824" returned: 0 in 0.485s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:27 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.290s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Deleted volume successfully.
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:27 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb
Sep 08 16:53:27 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ba6f8ba8-340d-45aa-9748-6d86a72f2fe2 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-842622cc-f396-42ce-8788-348d6d4d52b3-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-quobyte-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c" acquired by "delete_volume" :: waited 0.012s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e090183e-e423-48a2-8f12-5a01f76167cb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:27 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c
Sep 08 16:53:27 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:27 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb" returned: 0 in 0.273s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.791s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f4a4d9-722a-41bc-9920-ecad6e974bba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222a607155b545429eb8daf1984adf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:21Z,use_quota=True,user_id='88adae142df543758129693287740908',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0564caed-ed85-4164-87ee-202dc3e7637c),volume_type_id=0564caed-ed85-4164-87ee-202dc3e7637c)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Creating volume d4f4a4d9-722a-41bc-9920-ecad6e974bba {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:27 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:27 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba 1073741824
Sep 08 16:53:27 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434e819e-df1f-42e1-9348-31e4dd871e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49477171-9eb6-424e-ae67-b12a9d5f25bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:27 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Volume volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb (f850a4fb-1b75-4ff1-8e33-2b0939f288fb): created successfully
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49477171-9eb6-424e-ae67-b12a9d5f25bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Flow 'volume_create_manager' (dd1fe8f6-f8e9-4317-a00e-4e45a29d44f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-09b527b3-8b68-4e31-beed-99f972f12c2f tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created volume successfully.
Sep 08 16:53:27 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c" returned: 0 in 0.416s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:27 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c
Sep 08 16:53:27 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:28 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba 1073741824" returned: 0 in 0.461s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:28 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c" returned: 0 in 0.274s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c" released by "delete_volume" :: held 0.740s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:28 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba
Sep 08 16:53:28 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Created reservations ['531a4528-29e5-40b4-9d98-2d67a0eeaa93', '2c3ba6b3-fdb8-458e-9855-fd312fe8f480', '72781ac5-004b-4efc-a340-a284a9c550a3', '80d5ae30-5491-4f2c-9325-b56ce8c5aff3'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:28 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:28 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:28 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba" returned: 0 in 0.262s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.081s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1456558856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624ee208-11c1-4678-9e39-f72b2e626503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93e5a475c284c8f96a0441d884236d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:25Z,use_quota=True,user_id='c70943f2d82b47dd9caa3bd82c0e59d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Creating volume 624ee208-11c1-4678-9e39-f72b2e626503 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:28 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:28 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503 1073741824
Sep 08 16:53:28 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Attempting download of b5e5b4bf-9144-42b9-9c0a-14826134f567 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5e5b4bf-9144-42b9-9c0a-14826134f567', 'metadata': {}}])) to volume d4f4a4d9-722a-41bc-9920-ecad6e974bba. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:28 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.264s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[81504ee3-79d3-49fe-b7d0-769b21c0dc4d]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5e5b4bf-9144-42b9-9c0a-14826134f567_9rgwu_ur {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:28 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Deleted volume successfully.
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2cae6d55-4a1b-4cb7-af21-544f0e88b47a tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-dbf83c14-b52f-4c4b-b5e7-046a962ffb3c-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "cinder-quobyte-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acf2c1c-4df2-4c72-b748-863541e36f61]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:28 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5e5b4bf-9144-42b9-9c0a-14826134f567_9rgwu_ur
Sep 08 16:53:28 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-f850a4fb-1b75-4ff1-8e33-2b0939f288fb-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-f850a4fb-1b75-4ff1-8e33-2b0939f288fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-quobyte-f850a4fb-1b75-4ff1-8e33-2b0939f288fb" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-f850a4fb-1b75-4ff1-8e33-2b0939f288fb" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:28 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4
Sep 08 16:53:28 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2813f508-1b47-44c2-9d99-fdba64a75ce0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503 1073741824" returned: 0 in 0.567s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb
Sep 08 16:53:29 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5e5b4bf-9144-42b9-9c0a-14826134f567_9rgwu_ur" returned: 0 in 0.468s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e5b4bf-9144-42b9-9c0a-14826134f567_9rgwu_ur {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503
Sep 08 16:53:29 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4" returned: 0 in 0.446s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e5b4bf-9144-42b9-9c0a-14826134f567_9rgwu_ur
Sep 08 16:53:29 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4
Sep 08 16:53:29 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb" returned: 0 in 0.435s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503" returned: 0 in 0.319s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:29 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:29 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4fe43af-6275-4f63-b2db-7d5b58c8f3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624ee208-11c1-4678-9e39-f72b2e626503', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e681b2f-cb4d-42d2-96fe-8af3133aa860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:29 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Volume volume-624ee208-11c1-4678-9e39-f72b2e626503 (624ee208-11c1-4678-9e39-f72b2e626503): created successfully
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e681b2f-cb4d-42d2-96fe-8af3133aa860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:29 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Flow 'volume_create_manager' (2bdab74c-e285-4289-84bf-05a0805562df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e5b4bf-9144-42b9-9c0a-14826134f567_9rgwu_ur" returned: 1 in 0.397s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e5b4bf-9144-42b9-9c0a-14826134f567_9rgwu_ur' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d1bf72-e4ff-4e9c-add5-a73ba9b4d21c]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-a12968b8-90d8-4ea5-928a-1765fb6e880b tempest-ProjectReaderTests-1839813541 None] Created volume successfully.
Sep 08 16:53:29 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4" returned: 0 in 0.325s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-quobyte-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4" released by "delete_volume" :: held 0.835s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Created reservations ['01e77b02-e9c7-49b0-b5c0-b05f9c80653a', '15fdaac3-0c00-4c35-90f3-a80777aa8c23', '34d4bda3-e507-4d75-aad3-3c8f9c46713f', '480b94f9-8e49-4515-a342-10b46a132262'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:29 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD
Sep 08 16:53:29 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f850a4fb-1b75-4ff1-8e33-2b0939f288fb" returned: 0 in 0.276s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-f850a4fb-1b75-4ff1-8e33-2b0939f288fb" released by "delete_volume" :: held 0.773s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:29 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created reservations ['4998854f-b330-46e1-9505-8bb9fbb06917', 'e9cc1955-a23e-4466-9aa5-58700f217d56', 'e38fe8d6-b37d-4d4a-bd85-e3301130a40a', 'e4de22db-d098-4b10-970e-bf761ec5da4f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:29 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:29 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:29 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:30 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.338s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Deleted volume successfully.
Sep 08 16:53:30 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD
Sep 08 16:53:30 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-7568ef06-610a-4bd1-a270-2314754ec1d9-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-65215cde-49b4-4544-b8c8-3d4733bc0b10 tempest-CreateVolumesFromImageTest-488553973 None] Lock "cinder-9aee2bbc-c1d7-44b9-978e-61c8369b1bf4-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-7568ef06-610a-4bd1-a270-2314754ec1d9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-quobyte-7568ef06-610a-4bd1-a270-2314754ec1d9" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-7568ef06-610a-4bd1-a270-2314754ec1d9" acquired by "delete_volume" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:30 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.363s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Deleted volume successfully.
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7345a307-3947-45ff-a260-67de2fad3ef1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-296fb9a4-f89d-485e-a149-735a449964a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-f850a4fb-1b75-4ff1-8e33-2b0939f288fb-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:30 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9
Sep 08 16:53:30 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:30 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] b5e5b4bf-9144-42b9-9c0a-14826134f567 was raw, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:30 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba
Sep 08 16:53:30 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Acquiring lock "cinder-624ee208-11c1-4678-9e39-f72b2e626503-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Lock "cinder-624ee208-11c1-4678-9e39-f72b2e626503-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:30 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9" returned: 0 in 0.413s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:30 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9
Sep 08 16:53:30 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Acquiring lock "cinder-quobyte-624ee208-11c1-4678-9e39-f72b2e626503" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Lock "cinder-quobyte-624ee208-11c1-4678-9e39-f72b2e626503" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f4438-0d88-4c8b-a05b-8c0aea58680d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:30 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503
Sep 08 16:53:30 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:30 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7568ef06-610a-4bd1-a270-2314754ec1d9" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-7568ef06-610a-4bd1-a270-2314754ec1d9" released by "delete_volume" :: held 0.799s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:30 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba" returned: 0 in 0.615s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5e5b4bf-9144-42b9-9c0a-14826134f567_kav7xb0_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:53:31 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Converted 0.00 MB image at 0.00 MB/s
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:31 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba 1G
Sep 08 16:53:31 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created reservations ['11bcfe3f-b232-4977-9ed8-ef8eec524b6e', 'cc4f12b3-faa0-4897-a66f-7249cfd1770a', '7e16a04b-febe-4366-8855-7cd41e82f45d', '3d4b5f5a-56ce-4b10-a7c8-ba305222bc2a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:31 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:31 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:31 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503" returned: 0 in 0.535s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:31 devstack sudo[106593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503
Sep 08 16:53:31 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-da0f2244-2ed1-4710-b1d0-96bc2e0854fa-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-da0f2244-2ed1-4710-b1d0-96bc2e0854fa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-quobyte-da0f2244-2ed1-4710-b1d0-96bc2e0854fa" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-da0f2244-2ed1-4710-b1d0-96bc2e0854fa" acquired by "delete_volume" :: waited 0.042s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0805266d-6197-44bf-9d8e-706acc7834b1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:31 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba 1G" returned: 0 in 0.600s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Downloaded image b5e5b4bf-9144-42b9-9c0a-14826134f567 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5e5b4bf-9144-42b9-9c0a-14826134f567', 'metadata': {}}])) to volume d4f4a4d9-722a-41bc-9920-ecad6e974bba successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Temporary image b5e5b4bf-9144-42b9-9c0a-14826134f567 for user 88adae142df543758129693287740908 is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:53:31 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Marking volume d4f4a4d9-722a-41bc-9920-ecad6e974bba as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.424s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Deleted volume successfully.
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Copying metadata from image b5e5b4bf-9144-42b9-9c0a-14826134f567 to d4f4a4d9-722a-41bc-9920-ecad6e974bba. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Creating volume glance metadata for volume d4f4a4d9-722a-41bc-9920-ecad6e974bba backed by image b5e5b4bf-9144-42b9-9c0a-14826134f567 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b5e5b4bf-9144-42b9-9c0a-14826134f567', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '43ffd8a3f86dfa9ef1379ed02d28a171', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:53:31 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ab0a0934-6326-41a7-91ef-c94fbb9b3534 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-7568ef06-610a-4bd1-a270-2314754ec1d9-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-624ee208-11c1-4678-9e39-f72b2e626503" returned: 0 in 0.383s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Lock "cinder-quobyte-624ee208-11c1-4678-9e39-f72b2e626503" released by "delete_volume" :: held 0.986s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:31 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa
Sep 08 16:53:31 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18397e3b-bb24-4b55-b6be-513c6d9f9c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba', 'volume_size': 1, 'image_id': 'b5e5b4bf-9144-42b9-9c0a-14826134f567', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5e5b4bf-9144-42b9-9c0a-14826134f567', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '43ffd8a3f86dfa9ef1379ed02d28a171', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '222a607155b545429eb8daf1984adf55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c8dc319f724458ae3014876b8ae0c676c98a36fafa0d2a5763bb8535946070f882e7acaaaf640d2ea635a3fce31587fb3d15f0dd098c0a217bf8b861680155a3', 'id': 'b5e5b4bf-9144-42b9-9c0a-14826134f567', 'created_at': datetime.datetime(2026, 9, 8, 14, 53, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 53, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5e5b4bf-9144-42b9-9c0a-14826134f567/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a34364a9100>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1c4d87-f153-471d-b968-a49ebcf6146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Created reservations ['4d54752c-a985-4a03-84f3-24f9e396e1ff', 'ce58e453-27ed-4526-9e90-7da7919d5c8c', 'ae027119-4782-4a18-8e13-ce68c8943af9', '1401c80a-643d-4f41-98da-4014a9d83edf'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:31 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Volume volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba (d4f4a4d9-722a-41bc-9920-ecad6e974bba): created successfully
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d1c4d87-f153-471d-b968-a49ebcf6146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Flow 'volume_create_manager' (7d126096-e448-47bd-81a6-5c25f123b2ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b030d286-aa50-409c-9077-860d16f7b6fb tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Created volume successfully.
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:31 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:31 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:32 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa" returned: 0 in 0.458s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:32 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa
Sep 08 16:53:32 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:32 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.281s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:32 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Deleted volume successfully.
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-4d832f01-83d7-4895-a014-49118f08ae38 tempest-ProjectReaderTests-1839813541 None] Lock "cinder-624ee208-11c1-4678-9e39-f72b2e626503-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Acquiring lock "cinder-d4f4a4d9-722a-41bc-9920-ecad6e974bba-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "cinder-d4f4a4d9-722a-41bc-9920-ecad6e974bba-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Acquiring lock "cinder-quobyte-d4f4a4d9-722a-41bc-9920-ecad6e974bba" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:32 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-da0f2244-2ed1-4710-b1d0-96bc2e0854fa" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-da0f2244-2ed1-4710-b1d0-96bc2e0854fa" released by "delete_volume" :: held 0.861s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "cinder-quobyte-d4f4a4d9-722a-41bc-9920-ecad6e974bba" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[976ecdae-907b-4fc2-8863-db54910f0026]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created reservations ['de6d057b-9465-4c58-bf95-9c42ecf14da6', '82eb9da6-46dd-4694-b29e-2bba398ae204', '377597c2-fc0c-4f93-9c6b-d963d268b440', '442d7a0d-510d-485a-9bb5-a9f4adf47393'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:32 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba
Sep 08 16:53:32 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:32 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:32 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-d682a46c-609c-4961-b75f-6b1047c007f9-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-d682a46c-609c-4961-b75f-6b1047c007f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-quobyte-d682a46c-609c-4961-b75f-6b1047c007f9" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-d682a46c-609c-4961-b75f-6b1047c007f9" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4479d02f-0fae-45ea-acd7-c8c0104c197c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:32 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.352s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:32 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Deleted volume successfully.
Sep 08 16:53:32 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9
Sep 08 16:53:32 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-18b13f78-9302-4217-8e7e-dacfcce444e1 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-da0f2244-2ed1-4710-b1d0-96bc2e0854fa-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:32 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba" returned: 0 in 0.567s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:33 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba
Sep 08 16:53:33 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:33 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9" returned: 0 in 0.471s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:33 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9
Sep 08 16:53:33 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:33 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d4f4a4d9-722a-41bc-9920-ecad6e974bba" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "cinder-quobyte-d4f4a4d9-722a-41bc-9920-ecad6e974bba" released by "delete_volume" :: held 0.939s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Created reservations ['8577d0f1-1d62-4852-9e81-67fd1eee3a34', '511d3ccb-a869-40aa-9e61-dedf79a7e6fd', '348b4c0d-8229-44f2-8383-819c7f063dc8', 'c172ad9a-da04-4ad2-8a7d-69155dd2f33e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:33 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d682a46c-609c-4961-b75f-6b1047c007f9" returned: 0 in 0.346s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-d682a46c-609c-4961-b75f-6b1047c007f9" released by "delete_volume" :: held 0.887s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:33 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:33 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created reservations ['839cd91c-6c52-492f-a809-c9535d0117f2', '7b7168e1-cea6-4db9-a438-405620b94fb6', '72580d16-f40c-4f94-8c6a-f3b9e485a9c3', '515b2574-2cba-4b08-8ee8-8bfdc4b92f29'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:33 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:33 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:34 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Flow 'volume_create_manager' (db493ca3-dd77-46bd-8248-d9cd7efa7fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd92f67-beb3-45cb-a29d-54645a18bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd92f67-beb3-45cb-a29d-54645a18bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1800584083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56b6445-645a-4404-86f9-c3431a040723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9e53362a4d46169ecaed238c5f175d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:34Z,use_quota=True,user_id='74da2f512e2e4bf38e1fc938ccfcaec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d15ae6-33f2-4556-aa87-d4c22af174cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d15ae6-33f2-4556-aa87-d4c22af174cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abf8797-f859-45b4-8718-d864d9550bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abf8797-f859-45b4-8718-d864d9550bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56b6445-645a-4404-86f9-c3431a040723', 'volume_name': 'volume-e56b6445-645a-4404-86f9-c3431a040723', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea397e8-c0b6-443c-8aab-889ad101f893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea397e8-c0b6-443c-8aab-889ad101f893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69d0438-4987-4830-aeae-1eefc81e7def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Volume e56b6445-645a-4404-86f9-c3431a040723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56b6445-645a-4404-86f9-c3431a040723', 'volume_size': 1}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1800584083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56b6445-645a-4404-86f9-c3431a040723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9e53362a4d46169ecaed238c5f175d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:34Z,use_quota=True,user_id='74da2f512e2e4bf38e1fc938ccfcaec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Creating volume e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:34 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:34 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.525s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Deleted volume successfully.
Sep 08 16:53:34 devstack sudo[106639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 1073741824
Sep 08 16:53:34 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Deleted volume successfully.
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-032fc5fa-99e6-436b-acac-2755ea30e7d7 tempest-VolumeAndVolumeTypeFromImageTest-1271523511 None] Lock "cinder-d4f4a4d9-722a-41bc-9920-ecad6e974bba-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-df2c5c7e-67b2-4c7a-9c46-96af7bbeb897 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-d682a46c-609c-4961-b75f-6b1047c007f9-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:34 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 1073741824" returned: 0 in 0.469s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:34 devstack sudo[106645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723
Sep 08 16:53:34 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:34 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-4f7a987c-5be7-4e22-b245-d75db221c4f6-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-4f7a987c-5be7-4e22-b245-d75db221c4f6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69d0438-4987-4830-aeae-1eefc81e7def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56b6445-645a-4404-86f9-c3431a040723', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a3c5c8-62b8-4c34-b6f4-e0c52214d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:35 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Volume volume-e56b6445-645a-4404-86f9-c3431a040723 (e56b6445-645a-4404-86f9-c3431a040723): created successfully
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a3c5c8-62b8-4c34-b6f4-e0c52214d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Flow 'volume_create_manager' (db493ca3-dd77-46bd-8248-d9cd7efa7fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c61b61f5-cead-45a0-80e3-b3b48cb3803b tempest-VolumeDependencyTests-180708698 None] Created volume successfully.
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-quobyte-4f7a987c-5be7-4e22-b245-d75db221c4f6" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-4f7a987c-5be7-4e22-b245-d75db221c4f6" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f17b60e-ec61-4aa6-af59-5380db5500e1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:35 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6
Sep 08 16:53:35 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:35 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6" returned: 0 in 0.414s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:35 devstack sudo[106653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6
Sep 08 16:53:35 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:35 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-4f7a987c-5be7-4e22-b245-d75db221c4f6" returned: 0 in 0.309s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-4f7a987c-5be7-4e22-b245-d75db221c4f6" released by "delete_volume" :: held 0.776s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:35 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created reservations ['7a112517-91b0-424d-9d10-82073e2b2f77', '0f743576-076d-48fa-b2d7-520c35e720c2', 'f2897add-048d-4173-8fb3-5dd4e48174f5', 'b487388a-b70b-4c4c-a014-68d2946087ff'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:36 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:36 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-2e67c72e-e439-49f1-b2a8-d13c93891208-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-2e67c72e-e439-49f1-b2a8-d13c93891208-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "cinder-quobyte-2e67c72e-e439-49f1-b2a8-d13c93891208" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-2e67c72e-e439-49f1-b2a8-d13c93891208" acquired by "delete_volume" :: waited 0.051s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac469b-a074-431b-930b-f3dc8fbd2cbf]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Creating offline snapshot 50211fde-11e7-4d2d-b896-fbc089fec35c of volume e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:53:36 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9da2f9-3b18-4e0c-a693-9b323bacf945]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.534s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Deleted volume successfully.
Sep 08 16:53:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-749ea87f-a5e3-4939-8afd-6f34e979fc98 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-4f7a987c-5be7-4e22-b245-d75db221c4f6-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:36 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208
Sep 08 16:53:36 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:36 devstack sudo[106660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723
Sep 08 16:53:36 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:37 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208" returned: 0 in 0.506s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:37 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208
Sep 08 16:53:37 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:37 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723" returned: 0 in 0.520s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:37 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c 1G
Sep 08 16:53:37 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:37 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2e67c72e-e439-49f1-b2a8-d13c93891208" returned: 0 in 0.374s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-quobyte-2e67c72e-e439-49f1-b2a8-d13c93891208" released by "delete_volume" :: held 0.958s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Created reservations ['0053d1ba-0185-460c-a928-1df47bb4c71f', 'd023bde6-ebeb-462e-9974-e7758dc7103c', 'ee10bbd5-b8f1-4153-ba45-a3c50f1e612d', '2a40c030-2a69-490f-bed9-7b7d8a2e4cb5'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:37 devstack sudo[106677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:37 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:37 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c 1G" returned: 0 in 0.645s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56b6445-645a-4404-86f9-c3431a040723 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:37 devstack sudo[106680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56b6445-645a-4404-86f9-c3431a040723 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c
Sep 08 16:53:37 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:37 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Deleted volume successfully.
Sep 08 16:53:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3cb1874-b304-4d44-ba9e-e945316a68a2 tempest-CreateVolumesFromSourceVolumeTest-1538180076 None] Lock "cinder-2e67c72e-e439-49f1-b2a8-d13c93891208-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:38 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e56b6445-645a-4404-86f9-c3431a040723 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c" returned: 0 in 0.424s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:38 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c is being set with open permissions: ugo+rw
Sep 08 16:53:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:38 devstack sudo[106687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c
Sep 08 16:53:38 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:38 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c" returned: 0 in 0.319s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:38 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.info
Sep 08 16:53:38 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:38 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.info" returned: 0 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:38 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.info is being set with open permissions: ugo+rw
Sep 08 16:53:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:38 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.info
Sep 08 16:53:38 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:39 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.info" returned: 0 in 0.316s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1e62bb69-500b-456d-a756-3cf933115bf0 tempest-VolumeDependencyTests-180708698 None] Create snapshot completed successfully
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Flow 'volume_create_manager' (8ce8d526-d2a7-4d0f-b652-21631911cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9ad9b4-8794-4ef0-adaf-5ba97785f16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9ad9b4-8794-4ef0-adaf-5ba97785f16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-413998560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03975a19-a757-471e-909e-27eaa037fffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf9e53362a4d46169ecaed238c5f175d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50211fde-11e7-4d2d-b896-fbc089fec35c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:40Z,use_quota=True,user_id='74da2f512e2e4bf38e1fc938ccfcaec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af784c5-cb53-4bec-a978-7b823103e6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af784c5-cb53-4bec-a978-7b823103e6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2215f31c-83dd-416f-a69e-0017d4207139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2215f31c-83dd-416f-a69e-0017d4207139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03975a19-a757-471e-909e-27eaa037fffb', 'volume_name': 'volume-03975a19-a757-471e-909e-27eaa037fffb', 'volume_size': 1, 'snapshot_id': '50211fde-11e7-4d2d-b896-fbc089fec35c'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ead195a-7232-4734-bf87-e4b6a9e91d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ead195a-7232-4734-bf87-e4b6a9e91d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe697a-061b-497a-bdcd-4feb5404d550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:40 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Volume 03975a19-a757-471e-909e-27eaa037fffb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03975a19-a757-471e-909e-27eaa037fffb', 'volume_size': 1, 'snapshot_id': '50211fde-11e7-4d2d-b896-fbc089fec35c'}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-quobyte-50211fde-11e7-4d2d-b896-fbc089fec35c-03975a19-a757-471e-909e-27eaa037fffb" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-50211fde-11e7-4d2d-b896-fbc089fec35c-03975a19-a757-471e-909e-27eaa037fffb" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Creating volume 03975a19-a757-471e-909e-27eaa037fffb from snapshot 50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-quobyte-03975a19-a757-471e-909e-27eaa037fffb" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-03975a19-a757-471e-909e-27eaa037fffb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] snapshot: 50211fde-11e7-4d2d-b896-fbc089fec35c, volume: 03975a19-a757-471e-909e-27eaa037fffb,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff51da-fb1c-43a5-b685-27e967f08a45]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:40 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c
Sep 08 16:53:40 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:41 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c" returned: 0 in 0.523s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e56b6445-645a-4404-86f9-c3431a040723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a66da1-002f-436b-998a-6afe8af7dad2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:41 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723
Sep 08 16:53:41 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (cbacedd5-444e-4ae9-9393-aaf9fe5395fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32782bba-da22-4d0b-a718-ba1b1b7a5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32782bba-da22-4d0b-a718-ba1b1b7a5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687918707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:41Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6275e40-0620-4b96-a844-bca9bc249d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6275e40-0620-4b96-a844-bca9bc249d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:41 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c50b72-0263-49a5-b7a9-1ced88cc1cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c50b72-0263-49a5-b7a9-1ced88cc1cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff', 'volume_name': 'volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe19b64-914c-4eaa-9e1f-d1ea7e92a4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe19b64-914c-4eaa-9e1f-d1ea7e92a4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ae1ac8-99ff-4a19-b3dd-7f715533c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:41 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume 7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff', 'volume_size': 1}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723" returned: 0 in 0.463s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:53:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:41 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb
Sep 08 16:53:41 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:47 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb" returned: 0 in 5.712s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:53:47 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Converted 1024.00 MB image at 179.22 MB/s
Sep 08 16:53:47 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb is being set with open permissions: ugo+rw
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:47 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb
Sep 08 16:53:47 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:47 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb" returned: 0 in 0.316s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-03975a19-a757-471e-909e-27eaa037fffb" released by "_copy_volume_from_snapshot" :: held 7.122s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-50211fde-11e7-4d2d-b896-fbc089fec35c-03975a19-a757-471e-909e-27eaa037fffb" released by "_create_volume_from_snapshot" :: held 7.214s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.232s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.128s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687918707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:41Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Creating volume 7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:47 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fe697a-061b-497a-bdcd-4feb5404d550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03975a19-a757-471e-909e-27eaa037fffb', 'volume_size': 1, 'snapshot_id': '50211fde-11e7-4d2d-b896-fbc089fec35c'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:47 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff 1073741824
Sep 08 16:53:47 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4b5a09-9f64-4267-875e-5a2772e994b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:47 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Volume volume-03975a19-a757-471e-909e-27eaa037fffb (03975a19-a757-471e-909e-27eaa037fffb): created successfully
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4b5a09-9f64-4267-875e-5a2772e994b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Flow 'volume_create_manager' (8ce8d526-d2a7-4d0f-b652-21631911cf79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:47 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-49a44241-a859-471e-ae92-d75bdc1755de tempest-VolumeDependencyTests-180708698 None] Created volume successfully.
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-50211fde-11e7-4d2d-b896-fbc089fec35c-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-50211fde-11e7-4d2d-b896-fbc089fec35c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-quobyte-e56b6445-645a-4404-86f9-c3431a040723" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-e56b6445-645a-4404-86f9-c3431a040723" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-quobyte-50211fde-11e7-4d2d-b896-fbc089fec35c" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-50211fde-11e7-4d2d-b896-fbc089fec35c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Deleting offline snapshot 50211fde-11e7-4d2d-b896-fbc089fec35c of volume e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:53:48 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] snapshot_file for this snap is: volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff 1073741824" returned: 0 in 0.651s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09ac9b7-a5eb-4553-92ce-ec62b034d035]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:48 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff
Sep 08 16:53:48 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:48 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c
Sep 08 16:53:48 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:48 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" returned: 0 in 0.306s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ae1ac8-99ff-4a19-b3dd-7f715533c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44373b35-7d75-449a-92d1-0dee210f00bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff (7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff): created successfully
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44373b35-7d75-449a-92d1-0dee210f00bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (cbacedd5-444e-4ae9-9393-aaf9fe5395fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-176080a1-d444-4a05-9825-95541056845a tempest-CreateVolumesFromSnapshotTest-691325369 None] Created volume successfully.
Sep 08 16:53:49 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Flow 'volume_create_manager' (7cf54719-c8ab-4227-90f6-e7fd0ee974f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26787308-685a-41be-ad9b-9024790fcae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c" returned: 0 in 0.597s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e56b6445-645a-4404-86f9-c3431a040723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26787308-685a-41be-ad9b-9024790fcae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e966e2-c68f-42ff-82b0-f91f63dd51bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587f42ecddd045afba5a978378f3a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:49Z,use_quota=True,user_id='dbbeee1b3b3745f38622c5fda0ec99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae9eae2-0137-481c-ad98-91b8f298cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae9eae2-0137-481c-ad98-91b8f298cb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422f0a4b-05ef-44a7-b379-b0cb0f851974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.image.glance [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Creating Keystone auth plugin from conf {{(pid=87505) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db0e1e-da45-4968-b938-dd83a41ef42e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:49 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723
Sep 08 16:53:49 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422f0a4b-05ef-44a7-b379-b0cb0f851974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7e966e2-c68f-42ff-82b0-f91f63dd51bd', 'volume_name': 'volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd', 'volume_size': 1, 'image_id': '9711c160-ead2-432e-b646-50e34f3b058d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9711c160-ead2-432e-b646-50e34f3b058d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46f5f59a0f13009bb0fad4c9f203a5db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '587f42ecddd045afba5a978378f3a730', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a05ffbe2f67af03492f89aeadf4878cb24433b159858494256d0345552c47f981a1d4d3e4765a2bca2bbf45f0cb6c4e4aba440d9ab86e8c9ccdca9479b92c15f', 'id': '9711c160-ead2-432e-b646-50e34f3b058d', 'created_at': datetime.datetime(2026, 9, 8, 14, 53, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9711c160-ead2-432e-b646-50e34f3b058d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343608c050>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba18f18-a128-4e16-b7e1-253e5e9061a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba18f18-a128-4e16-b7e1-253e5e9061a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5309bad9-490f-444d-84d3-758aa5454189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:49 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Volume f7e966e2-c68f-42ff-82b0-f91f63dd51bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd', 'volume_size': 1, 'image_id': '9711c160-ead2-432e-b646-50e34f3b058d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9711c160-ead2-432e-b646-50e34f3b058d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46f5f59a0f13009bb0fad4c9f203a5db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '587f42ecddd045afba5a978378f3a730', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a05ffbe2f67af03492f89aeadf4878cb24433b159858494256d0345552c47f981a1d4d3e4765a2bca2bbf45f0cb6c4e4aba440d9ab86e8c9ccdca9479b92c15f', 'id': '9711c160-ead2-432e-b646-50e34f3b058d', 'created_at': datetime.datetime(2026, 9, 8, 14, 53, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9711c160-ead2-432e-b646-50e34f3b058d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343608c050>}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Trying to clone f7e966e2-c68f-42ff-82b0-f91f63dd51bd from image 9711c160-ead2-432e-b646-50e34f3b058d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9711c160-ead2-432e-b646-50e34f3b058d', 'metadata': {}}]). {{(pid=87505) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 08 16:53:49 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Image download 0.00 MB at 0.00 MB/s
Sep 08 16:53:49 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723" returned: 0 in 0.625s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:49 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c
Sep 08 16:53:49 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4797f56-ad1a-4be7-a07b-64caba91599e]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Creating offline snapshot b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 of volume 7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ca7d6-eb59-4443-be1f-e0c3a46aed91]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:49 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD
Sep 08 16:53:49 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:50 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff
Sep 08 16:53:50 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:50 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c" returned: 0 in 0.426s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:50 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c
Sep 08 16:53:50 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:50 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:50 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" returned: 0 in 0.427s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:50 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 1G
Sep 08 16:53:50 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:50 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD
Sep 08 16:53:50 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:50 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723.50211fde-11e7-4d2d-b896-fbc089fec35c" returned: 0 in 0.285s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-50211fde-11e7-4d2d-b896-fbc089fec35c" released by "_delete_snapshot" :: held 2.085s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-e56b6445-645a-4404-86f9-c3431a040723" released by "delete_snapshot" :: held 2.131s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Created reservations ['2b9edf94-c637-47b8-83a8-1ebd7985fa7e', '3777c9ba-7c01-40d0-9823-ec55f1c5e3c4', '7dff9677-9516-42a1-84ff-fd152667f2f8', '60c3f415-5f48-497d-882c-f016c3dc57e0'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:50 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Temporary image 9711c160-ead2-432e-b646-50e34f3b058d is fetched for user dbbeee1b3b3745f38622c5fda0ec99dd. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 08 16:53:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Delete snapshot completed successfully.
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-45ed8eb3-9cc6-4fcb-97e5-bcabeb6afec1 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-50211fde-11e7-4d2d-b896-fbc089fec35c-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed3a754-9c14-439e-9775-15a20c0722ff]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:50 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD
Sep 08 16:53:50 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:50 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 1G" returned: 0 in 0.539s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:50 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09
Sep 08 16:53:50 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:51 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:51 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:51 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 is being set with open permissions: ugo+rw
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:51 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD
Sep 08 16:53:51 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:51 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09
Sep 08 16:53:51 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:51 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:51 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:51 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.info
Sep 08 16:53:51 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-e56b6445-645a-4404-86f9-c3431a040723-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Lock "cinder-e56b6445-645a-4404-86f9-c3431a040723-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-quobyte-e56b6445-645a-4404-86f9-c3431a040723" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-e56b6445-645a-4404-86f9-c3431a040723" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[801321c2-3868-4aff-8656-06121dcfabd8]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:51 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.info" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:51 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.info is being set with open permissions: ugo+rw
Sep 08 16:53:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:51 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.info
Sep 08 16:53:51 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:51 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723
Sep 08 16:53:51 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:52 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.info" returned: 0 in 0.325s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e966e2-c68f-42ff-82b0-f91f63dd51bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587f42ecddd045afba5a978378f3a730',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:49Z,use_quota=True,user_id='dbbeee1b3b3745f38622c5fda0ec99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Creating volume f7e966e2-c68f-42ff-82b0-f91f63dd51bd {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:52 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:52 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e572bf76-2056-4dd0-8047-3027754a6bd8 tempest-CreateVolumesFromSnapshotTest-691325369 None] Create snapshot completed successfully
Sep 08 16:53:52 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd 1073741824
Sep 08 16:53:52 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723" returned: 0 in 0.470s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:52 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723
Sep 08 16:53:52 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:52 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e56b6445-645a-4404-86f9-c3431a040723" returned: 0 in 0.259s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-e56b6445-645a-4404-86f9-c3431a040723" released by "delete_volume" :: held 0.793s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Created reservations ['41908726-7eaf-41c2-aa52-acfff088694a', 'd9a31ad4-e99b-406f-ae8a-6cf168da7e75', '15bb67e7-7a5b-4d32-b309-c414964481ac', '711030c9-9e24-4932-9a60-f41c8cb8879b'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:52 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd 1073741824" returned: 0 in 0.478s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:52 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:52 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:52 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd
Sep 08 16:53:52 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-03975a19-a757-471e-909e-27eaa037fffb-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-03975a19-a757-471e-909e-27eaa037fffb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Acquiring lock "cinder-quobyte-03975a19-a757-471e-909e-27eaa037fffb" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-03975a19-a757-471e-909e-27eaa037fffb" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:53 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.369s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Deleted volume successfully.
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0693c3e7-72ba-4377-9293-87cdedb57260]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:53 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd" returned: 0 in 0.374s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-39b125ce-fc3a-4ed8-91fd-b7b4b6460dea tempest-VolumeDependencyTests-180708698 None] Lock "cinder-e56b6445-645a-4404-86f9-c3431a040723-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Attempting download of 9711c160-ead2-432e-b646-50e34f3b058d ((None, [{'url': 'file:///opt/stack/data/glance/images/9711c160-ead2-432e-b646-50e34f3b058d', 'metadata': {}}])) to volume f7e966e2-c68f-42ff-82b0-f91f63dd51bd. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 08 16:53:53 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb
Sep 08 16:53:53 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85eea03-9958-42f1-9062-fa5e5dfa5779]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9711c160-ead2-432e-b646-50e34f3b058d_fh2f7_ud {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:53 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9711c160-ead2-432e-b646-50e34f3b058d_fh2f7_ud
Sep 08 16:53:53 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:53 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9711c160-ead2-432e-b646-50e34f3b058d_fh2f7_ud" returned: 0 in 0.407s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9711c160-ead2-432e-b646-50e34f3b058d_fh2f7_ud {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:53 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb" returned: 0 in 0.605s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (0f2ddbd3-7e16-4682-a7f8-ca4269b14224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:53 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0729c16-e15b-4a5b-a6cf-d9f798c47e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:53 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0729c16-e15b-4a5b-a6cf-d9f798c47e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1090041204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f410e0-a53a-47b2-9117-a16b6bc0036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:54Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c192c2-5d59-47f4-9bd0-ae136ee23ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c192c2-5d59-47f4-9bd0-ae136ee23ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61ad5ba-0e95-4182-8ff1-f1e088e13878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61ad5ba-0e95-4182-8ff1-f1e088e13878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f410e0-a53a-47b2-9117-a16b6bc0036c', 'volume_name': 'volume-62f410e0-a53a-47b2-9117-a16b6bc0036c', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dabe6e-3245-4b45-813c-adfc328fc654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1dabe6e-3245-4b45-813c-adfc328fc654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c3e501-632b-47f0-b7a9-a437e7f49a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:53 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume 62f410e0-a53a-47b2-9117-a16b6bc0036c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f410e0-a53a-47b2-9117-a16b6bc0036c', 'volume_size': 1}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1090041204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f410e0-a53a-47b2-9117-a16b6bc0036c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:54Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Creating volume 62f410e0-a53a-47b2-9117-a16b6bc0036c {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:53 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:53 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9711c160-ead2-432e-b646-50e34f3b058d_fh2f7_ud
Sep 08 16:53:53 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:53 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c 1073741824
Sep 08 16:53:53 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:54 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-03975a19-a757-471e-909e-27eaa037fffb" returned: 0 in 0.438s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:54 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-quobyte-03975a19-a757-471e-909e-27eaa037fffb" released by "delete_volume" :: held 1.119s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9711c160-ead2-432e-b646-50e34f3b058d_fh2f7_ud" returned: 1 in 0.503s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9711c160-ead2-432e-b646-50e34f3b058d_fh2f7_ud' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec77c1b-36ec-492d-9bb3-4b65b5d423aa]: (4, 'raw') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (6494c12b-a56e-4e7f-8231-78df06636e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bd3baa-95da-46ff-be6a-57c69f3d85c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bd3baa-95da-46ff-be6a-57c69f3d85c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673296946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c31a01-d4a9-438d-925a-1f85e015da2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:54Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffde386e-8e00-4908-af12-3d9528a4179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:54 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD
Sep 08 16:53:54 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffde386e-8e00-4908-af12-3d9528a4179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc28bc6-3e71-43a9-818a-65cec3184413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc28bc6-3e71-43a9-818a-65cec3184413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c31a01-d4a9-438d-925a-1f85e015da2d', 'volume_name': 'volume-d5c31a01-d4a9-438d-925a-1f85e015da2d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc6c27e-912d-474a-b8f8-3668f37d97e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc6c27e-912d-474a-b8f8-3668f37d97e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589a06f4-5df5-475e-901a-5841b780305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:54 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume d5c31a01-d4a9-438d-925a-1f85e015da2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c31a01-d4a9-438d-925a-1f85e015da2d', 'volume_size': 1}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Created reservations ['372be662-d80d-409e-827e-f1e278fb0160', 'aad6b1fa-99fb-4564-8560-68a52647ae2a', '8e4c5ede-d00a-4ce6-b483-8153aef6782b', '0808e8fd-028f-4034-928d-b75a14dfafad'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:54 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:54 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:54 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c 1073741824" returned: 0 in 0.765s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:54 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c
Sep 08 16:53:54 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:54 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD" returned: 0 in 0.547s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:54 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Deleted volume successfully.
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (14c78227-8a5d-4867-92f4-5ad5086d15bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d90b43-5653-4252-acab-d60e1e0f352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:54 devstack sudo[106851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD
Sep 08 16:53:54 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-19a35c59-32e7-485c-983c-804580cd2280 tempest-VolumeDependencyTests-180708698 None] Lock "cinder-03975a19-a757-471e-909e-27eaa037fffb-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d90b43-5653-4252-acab-d60e1e0f352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295386813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4b303b-2026-40a6-aca0-5257dda5bf20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:55Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2ddfea-ea05-4b50-a1fa-e1e15cf6949c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2ddfea-ea05-4b50-a1fa-e1e15cf6949c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84012f8f-e76b-485d-8da1-16d6e46d7773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84012f8f-e76b-485d-8da1-16d6e46d7773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4b303b-2026-40a6-aca0-5257dda5bf20', 'volume_name': 'volume-af4b303b-2026-40a6-aca0-5257dda5bf20', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bb38d5-7aef-49de-b772-7d952cfe5d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bb38d5-7aef-49de-b772-7d952cfe5d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56bf0c1-0ffc-465c-b875-86c9154f83b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume af4b303b-2026-40a6-aca0-5257dda5bf20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4b303b-2026-40a6-aca0-5257dda5bf20', 'volume_size': 1}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:55 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c" returned: 0 in 0.446s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-673296946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c31a01-d4a9-438d-925a-1f85e015da2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:54Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Creating volume d5c31a01-d4a9-438d-925a-1f85e015da2d {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:55 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c3e501-632b-47f0-b7a9-a437e7f49a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f410e0-a53a-47b2-9117-a16b6bc0036c', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721ce1f1-3063-4510-ad51-1618cdf9944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d 1073741824
Sep 08 16:53:55 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume volume-62f410e0-a53a-47b2-9117-a16b6bc0036c (62f410e0-a53a-47b2-9117-a16b6bc0036c): created successfully
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721ce1f1-3063-4510-ad51-1618cdf9944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (0f2ddbd3-7e16-4682-a7f8-ca4269b14224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD" returned: 1 in 0.530s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] 9711c160-ead2-432e-b646-50e34f3b058d was raw, converting to qcow2 {{(pid=87505) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:55 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-16412e5e-a5b7-46dd-8554-0f8604388b78 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created volume successfully.
Sep 08 16:53:55 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd
Sep 08 16:53:55 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (e73f04f9-9391-44a1-a2a7-c05effc9be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6576b1-dfb3-40a0-8965-12e63f753606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6576b1-dfb3-40a0-8965-12e63f753606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296690542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1995968-766c-4811-ab65-059e6621d3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:56Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2611c239-aa4f-498c-bbb7-5dbf0943c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2611c239-aa4f-498c-bbb7-5dbf0943c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094484ce-ebb4-4a95-a30c-25f1e9b01311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094484ce-ebb4-4a95-a30c-25f1e9b01311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1995968-766c-4811-ab65-059e6621d3d2', 'volume_name': 'volume-e1995968-766c-4811-ab65-059e6621d3d2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3332a3-5583-4967-a242-f6ce8f45b402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3332a3-5583-4967-a242-f6ce8f45b402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa13bffd-5d79-41c4-a74a-352fe38a254d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume e1995968-766c-4811-ab65-059e6621d3d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1995968-766c-4811-ab65-059e6621d3d2', 'volume_size': 1}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:55 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d 1073741824" returned: 0 in 0.801s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:55 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd" returned: 0 in 0.690s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9711c160-ead2-432e-b646-50e34f3b058d_kmpcch77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:53:55 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Converted 0.00 MB image at 0.00 MB/s
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:56 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd 1G
Sep 08 16:53:56 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:56 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d
Sep 08 16:53:56 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (17c7b54e-f680-4dfb-9386-a368e628f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98218598-08ea-4ded-937f-dac9f4327c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98218598-08ea-4ded-937f-dac9f4327c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279234043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c51e1b-ed12-4f30-9621-74883a4ff9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:56Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea8a9a9-9721-4f0d-a824-4bfb0bc5e856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea8a9a9-9721-4f0d-a824-4bfb0bc5e856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0cb0e7-6731-4a9e-afa9-ba78f410c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0cb0e7-6731-4a9e-afa9-ba78f410c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c51e1b-ed12-4f30-9621-74883a4ff9ee', 'volume_name': 'volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fd7a57-aa57-4329-a263-7889ec45e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00fd7a57-aa57-4329-a263-7889ec45e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5beaf3-bd71-4de9-baa7-03c27ef10fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:56 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume e6c51e1b-ed12-4f30-9621-74883a4ff9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee', 'volume_size': 1}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:56 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d" returned: 0 in 0.417s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.381s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295386813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4b303b-2026-40a6-aca0-5257dda5bf20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:55Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Creating volume af4b303b-2026-40a6-aca0-5257dda5bf20 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:56 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:56 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589a06f4-5df5-475e-901a-5841b780305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c31a01-d4a9-438d-925a-1f85e015da2d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0220251-af49-4ea5-a4e3-922d403453b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:56 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20 1073741824
Sep 08 16:53:56 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd 1G" returned: 0 in 0.529s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Downloaded image 9711c160-ead2-432e-b646-50e34f3b058d ((None, [{'url': 'file:///opt/stack/data/glance/images/9711c160-ead2-432e-b646-50e34f3b058d', 'metadata': {}}])) to volume f7e966e2-c68f-42ff-82b0-f91f63dd51bd successfully. {{(pid=87505) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Temporary image 9711c160-ead2-432e-b646-50e34f3b058d for user dbbeee1b3b3745f38622c5fda0ec99dd is deleted. {{(pid=87505) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.volume_utils [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Marking volume f7e966e2-c68f-42ff-82b0-f91f63dd51bd as bootable. {{(pid=87505) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 08 16:53:56 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume volume-d5c31a01-d4a9-438d-925a-1f85e015da2d (d5c31a01-d4a9-438d-925a-1f85e015da2d): created successfully
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0220251-af49-4ea5-a4e3-922d403453b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (6494c12b-a56e-4e7f-8231-78df06636e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Copying metadata from image 9711c160-ead2-432e-b646-50e34f3b058d to f7e966e2-c68f-42ff-82b0-f91f63dd51bd. {{(pid=87505) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Creating volume glance metadata for volume f7e966e2-c68f-42ff-82b0-f91f63dd51bd backed by image 9711c160-ead2-432e-b646-50e34f3b058d with: {'image_id': '9711c160-ead2-432e-b646-50e34f3b058d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '46f5f59a0f13009bb0fad4c9f203a5db', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87505) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 08 16:53:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-fe65b8c6-d05c-480d-a591-b926ae2f363f tempest-CreateVolumesFromSnapshotTest-691325369 None] Created volume successfully.
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:56 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:56 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5309bad9-490f-444d-84d3-758aa5454189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd', 'volume_size': 1, 'image_id': '9711c160-ead2-432e-b646-50e34f3b058d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9711c160-ead2-432e-b646-50e34f3b058d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '46f5f59a0f13009bb0fad4c9f203a5db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '587f42ecddd045afba5a978378f3a730', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a05ffbe2f67af03492f89aeadf4878cb24433b159858494256d0345552c47f981a1d4d3e4765a2bca2bbf45f0cb6c4e4aba440d9ab86e8c9ccdca9479b92c15f', 'id': '9711c160-ead2-432e-b646-50e34f3b058d', 'created_at': datetime.datetime(2026, 9, 8, 14, 53, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 14, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9711c160-ead2-432e-b646-50e34f3b058d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a343608c050>}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0c2401-1f2c-4005-97f3-a58a615332da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:56 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Volume volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd (f7e966e2-c68f-42ff-82b0-f91f63dd51bd): created successfully
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0c2401-1f2c-4005-97f3-a58a615332da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Flow 'volume_create_manager' (7cf54719-c8ab-4227-90f6-e7fd0ee974f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-63e685b6-7a4c-4b8f-9397-80558d0a0ceb tempest-VolumeImageDependencyTests-1129714662 None] Created volume successfully.
Sep 08 16:53:57 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.441s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:53:57 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20 1073741824" returned: 0 in 0.724s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:57 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20
Sep 08 16:53:57 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:57 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-296690542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1995968-766c-4811-ab65-059e6621d3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:56Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Creating volume e1995968-766c-4811-ab65-059e6621d3d2 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:57 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56bf0c1-0ffc-465c-b875-86c9154f83b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4b303b-2026-40a6-aca0-5257dda5bf20', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:57 devstack sudo[106890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2 1073741824
Sep 08 16:53:57 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc162b74-2f2d-4b01-baa0-3ba1d7650af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:57 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume volume-af4b303b-2026-40a6-aca0-5257dda5bf20 (af4b303b-2026-40a6-aca0-5257dda5bf20): created successfully
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc162b74-2f2d-4b01-baa0-3ba1d7650af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (14c78227-8a5d-4867-92f4-5ad5086d15bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ac9d435c-7338-41df-bbe7-243391aba652 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created volume successfully.
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Acquiring lock "cinder-f7e966e2-c68f-42ff-82b0-f91f63dd51bd-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Lock "cinder-f7e966e2-c68f-42ff-82b0-f91f63dd51bd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Acquiring lock "cinder-quobyte-f7e966e2-c68f-42ff-82b0-f91f63dd51bd" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Lock "cinder-quobyte-f7e966e2-c68f-42ff-82b0-f91f63dd51bd" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c7ec0-ae2b-4d08-8291-f1eb35c97407]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:58 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2 1073741824" returned: 0 in 0.608s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:58 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2
Sep 08 16:53:58 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd
Sep 08 16:53:58 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:58 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:58 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2" returned: 0 in 0.282s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.183s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279234043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c51e1b-ed12-4f30-9621-74883a4ff9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b686e3c2e7454eb1beabb4042837d30f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:53:56Z,use_quota=True,user_id='b7ac32be9f544b82906ed7c1913fc452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Creating volume e6c51e1b-ed12-4f30-9621-74883a4ff9ee {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:53:58 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:58 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee 1073741824
Sep 08 16:53:58 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa13bffd-5d79-41c4-a74a-352fe38a254d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1995968-766c-4811-ab65-059e6621d3d2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ded3aa-8d5a-4d76-8ae7-4ece832c38be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:58 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume volume-e1995968-766c-4811-ab65-059e6621d3d2 (e1995968-766c-4811-ab65-059e6621d3d2): created successfully
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ded3aa-8d5a-4d76-8ae7-4ece832c38be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (e73f04f9-9391-44a1-a2a7-c05effc9be61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:58 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:58 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8cc280a2-5b7b-4d4d-9ff5-009ecbca2db7 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created volume successfully.
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd" returned: 0 in 0.537s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:58 devstack sudo[106906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd
Sep 08 16:53:58 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:58 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f7e966e2-c68f-42ff-82b0-f91f63dd51bd" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Lock "cinder-quobyte-f7e966e2-c68f-42ff-82b0-f91f63dd51bd" released by "delete_volume" :: held 0.938s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Created reservations ['1c947f6a-43f5-4b73-8b47-66ddd35533d4', 'cac29484-2fa7-41a4-a057-1b8ba0a80206', '00ceebd0-ff6c-4e53-a4c3-6e0ef171e287', '54968d60-e878-4b81-858a-1e9dce7fa8bb'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:59 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:59 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee 1073741824" returned: 0 in 0.693s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:59 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:53:59 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee
Sep 08 16:53:59 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:53:59 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:53:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Deleted volume successfully.
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8c59dff1-e629-46a6-a94d-952b00cc4444 tempest-VolumeImageDependencyTests-1129714662 None] Lock "cinder-f7e966e2-c68f-42ff-82b0-f91f63dd51bd-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:53:59 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee" returned: 0 in 0.585s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5beaf3-bd71-4de9-baa7-03c27ef10fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1831a3d6-1284-42a6-be75-cdba4883b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:53:59 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Volume volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee (e6c51e1b-ed12-4f30-9621-74883a4ff9ee): created successfully
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1831a3d6-1284-42a6-be75-cdba4883b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:53:59 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Flow 'volume_create_manager' (17c7b54e-f680-4dfb-9386-a368e628f831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:53:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-58c02cee-8960-4e6e-a210-8f7a9b1babe2 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created volume successfully.
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (6a187440-69e5-4482-b43d-d243ba6d6d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b7e473-704b-4896-82ea-b7c3716058c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b7e473-704b-4896-82ea-b7c3716058c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482318647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d147d6cc-c2bd-49ae-8565-2f2099d6da1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:01Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370a0f97-0c10-4eb8-83a7-c61ce0228497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370a0f97-0c10-4eb8-83a7-c61ce0228497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ca02d-f8b9-4ff1-bcfb-f8a5411dd7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ca02d-f8b9-4ff1-bcfb-f8a5411dd7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd147d6cc-c2bd-49ae-8565-2f2099d6da1b', 'volume_name': 'volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39db089-e21d-45d3-9ce9-53ecdee64975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39db089-e21d-45d3-9ce9-53ecdee64975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f7df1a-4ce7-44f4-8aca-1e73e07b918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:00 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Volume d147d6cc-c2bd-49ae-8565-2f2099d6da1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b', 'volume_size': 1}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482318647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d147d6cc-c2bd-49ae-8565-2f2099d6da1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:01Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Creating volume d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:00 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:00 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b 1073741824
Sep 08 16:54:00 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-e6c51e1b-ed12-4f30-9621-74883a4ff9ee-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-e6c51e1b-ed12-4f30-9621-74883a4ff9ee-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-e6c51e1b-ed12-4f30-9621-74883a4ff9ee" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-e6c51e1b-ed12-4f30-9621-74883a4ff9ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[97011adb-eefd-4061-b306-5a81ae715ef5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:01 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee
Sep 08 16:54:01 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:01 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b 1073741824" returned: 0 in 0.609s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:01 devstack sudo[106963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b
Sep 08 16:54:01 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:01 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee" returned: 0 in 0.512s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:01 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee
Sep 08 16:54:01 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:01 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" returned: 0 in 0.426s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f7df1a-4ce7-44f4-8aca-1e73e07b918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb449b9-2cee-490b-ad4d-3ac0a9af303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:01 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:01 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Volume volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b (d147d6cc-c2bd-49ae-8565-2f2099d6da1b): created successfully
Sep 08 16:54:01 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb449b9-2cee-490b-ad4d-3ac0a9af303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (6a187440-69e5-4482-b43d-d243ba6d6d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e6c51e1b-ed12-4f30-9621-74883a4ff9ee" returned: 0 in 0.315s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-e6c51e1b-ed12-4f30-9621-74883a4ff9ee" released by "delete_volume" :: held 0.887s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-046446e4-20e0-43a8-b077-2654aa3d279b tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Created reservations ['aad68ea6-7cf5-46f2-b61b-e3cf871a4d95', 'fd2796fb-c5df-4ea1-8b70-ba5adaf507a8', 'a1f58226-9821-4020-aa34-75d1b420b0bc', '849c766c-765a-4d5b-a26d-da5398d0ef2e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:02 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:02 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-e1995968-766c-4811-ab65-059e6621d3d2-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-e1995968-766c-4811-ab65-059e6621d3d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-e1995968-766c-4811-ab65-059e6621d3d2" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-e1995968-766c-4811-ab65-059e6621d3d2" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cace8ba-fc14-471f-a48e-8aebce9730b3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:02 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.319s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:02 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Deleted volume successfully.
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-f56b3c6c-3913-45b6-a697-0430850df03d tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-e6c51e1b-ed12-4f30-9621-74883a4ff9ee-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:02 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2
Sep 08 16:54:02 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:02 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2" returned: 0 in 0.494s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:02 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2
Sep 08 16:54:02 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:03 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1995968-766c-4811-ab65-059e6621d3d2" returned: 0 in 0.332s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-e1995968-766c-4811-ab65-059e6621d3d2" released by "delete_volume" :: held 0.899s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created reservations ['14bb525b-c62e-425c-be22-51bd61ae2eba', '0c99011c-9d78-4298-ba9e-4cf616135c53', 'd8bf8a57-5d4f-4645-814e-7da74297ffa5', 'da35a565-d6ed-4dea-b3a4-2c85e4a3f74c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:03 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:03 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot 31b547f2-747a-44b4-9759-bac0bbe12354 of volume d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96672c6-c5c8-4457-9b53-5e31c06701b6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:03 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.279s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Deleted volume successfully.
Sep 08 16:54:03 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0565fbdc-a761-4132-94bb-90571fd409d4 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-e1995968-766c-4811-ab65-059e6621d3d2-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:03 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b
Sep 08 16:54:03 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:04 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" returned: 0 in 0.489s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:04 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 1G
Sep 08 16:54:04 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-af4b303b-2026-40a6-aca0-5257dda5bf20-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-af4b303b-2026-40a6-aca0-5257dda5bf20-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-af4b303b-2026-40a6-aca0-5257dda5bf20" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-af4b303b-2026-40a6-aca0-5257dda5bf20" acquired by "delete_volume" :: waited 0.047s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:04 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 1G" returned: 0 in 0.583s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[de31f774-197c-4532-b22b-69618fef0bef]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:04 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354
Sep 08 16:54:04 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:04 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20
Sep 08 16:54:04 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:05 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354" returned: 0 in 0.415s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:05 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 is being set with open permissions: ugo+rw
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:05 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354
Sep 08 16:54:05 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:05 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20" returned: 0 in 0.505s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:05 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20
Sep 08 16:54:05 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:05 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354" returned: 0 in 0.316s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:05 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:05 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.info
Sep 08 16:54:05 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-af4b303b-2026-40a6-aca0-5257dda5bf20" returned: 0 in 0.280s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-af4b303b-2026-40a6-aca0-5257dda5bf20" released by "delete_volume" :: held 0.867s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created reservations ['ad8be2cf-36af-4372-8e12-6efc31fdbee4', '0fdafb0e-ee23-41ec-aba3-877edb11fa08', '93dcf750-b0ec-4924-abd0-967ec836c443', 'a75831f2-a44f-4e94-8ee4-e6ffb643cdf7'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:05 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:05 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-d5c31a01-d4a9-438d-925a-1f85e015da2d-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-d5c31a01-d4a9-438d-925a-1f85e015da2d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-d5c31a01-d4a9-438d-925a-1f85e015da2d" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:06 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-d5c31a01-d4a9-438d-925a-1f85e015da2d" acquired by "delete_volume" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.info" returned: 0 in 0.479s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:06 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.info is being set with open permissions: ugo+rw
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f041e12f-cbb6-4e89-934c-e3bbdd67cdaa]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:06 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.info
Sep 08 16:54:06 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:06 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.401s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Deleted volume successfully.
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b676f933-5651-4780-95ad-49f2d2967354 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-af4b303b-2026-40a6-aca0-5257dda5bf20-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:06 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d
Sep 08 16:54:06 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:06 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.info" returned: 0 in 0.321s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.717s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-37fcb6fd-9142-4205-918d-5d448c9cc2cd tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:54:06 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d" returned: 0 in 0.497s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:06 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d
Sep 08 16:54:06 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:06 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d5c31a01-d4a9-438d-925a-1f85e015da2d" returned: 0 in 0.325s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-31b547f2-747a-44b4-9759-bac0bbe12354-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-d5c31a01-d4a9-438d-925a-1f85e015da2d" released by "delete_volume" :: held 0.909s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-31b547f2-747a-44b4-9759-bac0bbe12354-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-31b547f2-747a-44b4-9759-bac0bbe12354" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-31b547f2-747a-44b4-9759-bac0bbe12354" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot 31b547f2-747a-44b4-9759-bac0bbe12354 of volume d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1de4ef-f94c-465d-b9b0-1357adead127]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created reservations ['66a9e6b3-8b5e-4afa-8a6c-7616e93411d6', '300c66f4-b96e-467c-8a6c-0602e02210f0', 'f680e975-853d-4cbf-b2d6-0f71be51ce63', 'd1d781ce-96b5-47ca-9753-56665ef0dd93'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:07 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354
Sep 08 16:54:07 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:07 devstack sudo[107035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:07 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:07 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Deleted volume successfully.
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-86217963-30b6-41d0-9eec-a4469477f616 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-d5c31a01-d4a9-438d-925a-1f85e015da2d-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:07 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354" returned: 0 in 0.431s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c10e57-c1fb-4677-8f89-55684da0aa5c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:07 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b
Sep 08 16:54:07 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:07 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" returned: 0 in 0.493s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:08 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354
Sep 08 16:54:08 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-62f410e0-a53a-47b2-9117-a16b6bc0036c-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-62f410e0-a53a-47b2-9117-a16b6bc0036c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-62f410e0-a53a-47b2-9117-a16b6bc0036c" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-62f410e0-a53a-47b2-9117-a16b6bc0036c" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b665a4-980f-4e16-89fe-56045926bac9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:08 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354" returned: 0 in 0.449s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:08 devstack sudo[107052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354
Sep 08 16:54:08 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:08 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c
Sep 08 16:54:08 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:08 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b.31b547f2-747a-44b4-9759-bac0bbe12354" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-31b547f2-747a-44b4-9759-bac0bbe12354" released by "_delete_snapshot" :: held 1.807s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" released by "delete_snapshot" :: held 1.834s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:08 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c" returned: 0 in 0.493s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:08 devstack sudo[107060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c
Sep 08 16:54:08 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:08 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Created reservations ['8ed67077-23f9-4b97-949c-a00e401f834b', 'dba4b8b2-da3b-4a6e-a790-d9f9f413cc35', '27ddca95-729c-4a36-af2d-3543c9745396', '322ad632-56f1-445c-81f2-86ff96fa749e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:09 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-277a608b-21db-4a27-a5a6-002f5838fe05 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-31b547f2-747a-44b4-9759-bac0bbe12354-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-d147d6cc-c2bd-49ae-8565-2f2099d6da1b-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-d147d6cc-c2bd-49ae-8565-2f2099d6da1b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:09 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-62f410e0-a53a-47b2-9117-a16b6bc0036c" returned: 0 in 0.404s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[79582c3e-a609-49ca-bd5d-f83bd276f037]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-62f410e0-a53a-47b2-9117-a16b6bc0036c" released by "delete_volume" :: held 0.958s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created reservations ['7a0649be-0d12-405b-9173-e1b45875db9d', '98b55aaa-a1d1-4352-bb25-5529eeee7207', '3f11ea6e-bb31-439a-8d7a-5b9ece4ddaa1', '4a6a17ae-39a4-48b7-bb09-9ca1883eacdb'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:09 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b
Sep 08 16:54:09 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:09 devstack sudo[107071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:09 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:09 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" returned: 0 in 0.418s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:09 devstack sudo[107077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b
Sep 08 16:54:09 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:09 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.287s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:09 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Deleted volume successfully.
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-b03a62fb-f148-4048-93fe-e9b037b224e0 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-62f410e0-a53a-47b2-9117-a16b6bc0036c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:09 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" returned: 0 in 0.266s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-d147d6cc-c2bd-49ae-8565-2f2099d6da1b" released by "delete_volume" :: held 0.758s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:09 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=200,cinder:UPDATE=254,cinder:DELETE=28,cinder:INSERT=72 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Created reservations ['17987a39-265b-41ab-94b8-b4b828ba63fb', '91fbe6fb-8233-4566-8751-8c24fa223fca', '6736c3ec-5b3b-4dd9-a77b-4c91df381142', '6b793d88-555a-465f-8331-69c3ed5792d7'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:10 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:10 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:10 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.313s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d60c818-45da-4014-a95b-6d3b082c7386 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-d147d6cc-c2bd-49ae-8565-2f2099d6da1b-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Deleting offline snapshot b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 of volume 7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] snapshot_file for this snap is: volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb85fe90-60e4-42b4-b92c-823db825e17d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:10 devstack sudo[107083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09
Sep 08 16:54:10 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=288,cinder:SELECT=193,cinder:INSERT=72,cinder:DELETE=21 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:11 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (071e5b7b-5cac-44b9-b292-4c53e17839ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7ea7c-a3b1-46e2-9f28-b7b753e76091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" returned: 0 in 0.590s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7ea7c-a3b1-46e2-9f28-b7b753e76091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81806675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afecb64-b911-4e1d-901b-1326e37abdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:11Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b567310-c4d0-4d54-bea6-9783448cddc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b567310-c4d0-4d54-bea6-9783448cddc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f60d4d-ef86-4d17-b850-97fc48d3aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f60d4d-ef86-4d17-b850-97fc48d3aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9afecb64-b911-4e1d-901b-1326e37abdc5', 'volume_name': 'volume-9afecb64-b911-4e1d-901b-1326e37abdc5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4935d6ad-ca11-4a52-bdd8-74810dede5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4935d6ad-ca11-4a52-bdd8-74810dede5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac8be4-bcbe-4aba-82da-047ea719ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:11 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Volume 9afecb64-b911-4e1d-901b-1326e37abdc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9afecb64-b911-4e1d-901b-1326e37abdc5', 'volume_size': 1}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81806675',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afecb64-b911-4e1d-901b-1326e37abdc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:11Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Creating volume 9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:11 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb13770d-3089-4335-889a-53f99591a7bb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:11 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 1073741824
Sep 08 16:54:11 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:11 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff
Sep 08 16:54:11 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:11 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" returned: 0 in 0.449s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:11 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09
Sep 08 16:54:11 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:11 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 1073741824" returned: 0 in 0.585s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:12 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5
Sep 08 16:54:12 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:12 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" returned: 0 in 0.411s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:12 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09
Sep 08 16:54:12 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:12 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5" returned: 0 in 0.326s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ac8be4-bcbe-4aba-82da-047ea719ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afecb64-b911-4e1d-901b-1326e37abdc5', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d02e40-9c58-49ab-a688-3b7e62bb28f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:12 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Volume volume-9afecb64-b911-4e1d-901b-1326e37abdc5 (9afecb64-b911-4e1d-901b-1326e37abdc5): created successfully
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d02e40-9c58-49ab-a688-3b7e62bb28f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (071e5b7b-5cac-44b9-b292-4c53e17839ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6f8bbb77-4c49-4c3e-afd3-f04776674f41 tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:54:12 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff.b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" returned: 0 in 0.297s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09" released by "_delete_snapshot" :: held 1.961s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" released by "delete_snapshot" :: held 2.004s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Created reservations ['505e2661-fe48-4036-91e4-045d00f2c129', '0a1e33d1-31df-4cb1-a8af-cbece7b4a7d3', 'b738eb8f-b2d4-489a-9519-0272d18dd8b7', '0c75d80d-ad56-4faa-a1ec-60d034a2453a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Delete snapshot completed successfully.
Sep 08 16:54:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2b6acf88-d934-479f-a280-dd2d2125f748 tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-b0d2cec8-0202-4f6b-99b7-ecd74b0e9b09-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot 7fbcf7e4-a904-409d-b107-b7d491362a3b of volume 9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f9fe1-9431-4b95-a812-ac538bf24481]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:13 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5
Sep 08 16:54:13 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "cinder-quobyte-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" acquired by "delete_volume" :: waited 0.039s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e42b8e-7df7-4f33-8594-44cb1b8ec457]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:13 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5" returned: 0 in 0.548s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:14 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b 1G
Sep 08 16:54:14 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:14 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff
Sep 08 16:54:14 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:14 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" returned: 0 in 0.490s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:14 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff
Sep 08 16:54:14 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:14 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b 1G" returned: 0 in 0.636s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afecb64-b911-4e1d-901b-1326e37abdc5 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:14 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afecb64-b911-4e1d-901b-1326e37abdc5 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b
Sep 08 16:54:14 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:14 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" returned: 0 in 0.512s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-quobyte-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff" released by "delete_volume" :: held 1.106s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Created reservations ['cbd1f5ae-ffdc-431e-a076-1adbcc0142cb', '36617907-a1d1-40fe-a916-4a6101abb8b5', '2b20cf2e-5249-41b7-bd8a-4699812dc9c6', '09585bd3-8e3c-41b5-bdc3-675d7eb416b7'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:15 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9afecb64-b911-4e1d-901b-1326e37abdc5 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b" returned: 0 in 0.491s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:15 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b is being set with open permissions: ugo+rw
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:15 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b
Sep 08 16:54:15 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:15 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:15 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:15 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b" returned: 0 in 0.441s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:15 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.info
Sep 08 16:54:15 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:15 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.480s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Deleted volume successfully.
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7007e7d8-c992-4d8f-b6f5-d99b20ea583e tempest-CreateVolumesFromSnapshotTest-691325369 None] Lock "cinder-7cdf3c38-13b4-4001-b4b3-4dbc6f54c8ff-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:15 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.info" returned: 0 in 0.337s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:15 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.info is being set with open permissions: ugo+rw
Sep 08 16:54:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:15 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.info
Sep 08 16:54:15 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:16 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.info" returned: 0 in 0.277s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:16 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-19844fb5-3f47-4be7-8534-0f5d052dd4e3 tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-7fbcf7e4-a904-409d-b107-b7d491362a3b-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Lock "cinder-7fbcf7e4-a904-409d-b107-b7d491362a3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-9afecb64-b911-4e1d-901b-1326e37abdc5" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-9afecb64-b911-4e1d-901b-1326e37abdc5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-7fbcf7e4-a904-409d-b107-b7d491362a3b" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-7fbcf7e4-a904-409d-b107-b7d491362a3b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot 7fbcf7e4-a904-409d-b107-b7d491362a3b of volume 9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[478980b1-5a69-4e0e-849f-1ea327f754a2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:17 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b
Sep 08 16:54:17 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:17 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b" returned: 0 in 0.543s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9afecb64-b911-4e1d-901b-1326e37abdc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:17 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0222e88-ba8c-4270-b867-007666db6cec]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:17 devstack sudo[107154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5
Sep 08 16:54:17 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:17 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5" returned: 0 in 0.523s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:18 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b
Sep 08 16:54:18 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:18 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b" returned: 0 in 0.399s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:18 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b
Sep 08 16:54:18 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Flow 'volume_create_manager' (24fb1e58-98ea-4a8a-8efd-f42687bb3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd363cfa-97a4-44c4-9b35-25f3e79c1081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd363cfa-97a4-44c4-9b35-25f3e79c1081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1687754834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076f9248-f18d-43bb-af2b-5846384423d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbce3dfc85174d35a7ee72c7a237a555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:18Z,use_quota=True,user_id='a0b7321b5d9e4078b1480b14048ff56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018b01e2-aceb-4da0-a240-d79a2c07a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018b01e2-aceb-4da0-a240-d79a2c07a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578e1fc1-280e-4cb8-9a5d-ea71a604137a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578e1fc1-280e-4cb8-9a5d-ea71a604137a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '076f9248-f18d-43bb-af2b-5846384423d2', 'volume_name': 'volume-076f9248-f18d-43bb-af2b-5846384423d2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc074ebb-733e-4023-91df-7327dc5a37cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc074ebb-733e-4023-91df-7327dc5a37cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee68010-290c-4bf5-9cf6-12085ef5dd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:18 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Volume 076f9248-f18d-43bb-af2b-5846384423d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-076f9248-f18d-43bb-af2b-5846384423d2', 'volume_size': 1}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1687754834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=076f9248-f18d-43bb-af2b-5846384423d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbce3dfc85174d35a7ee72c7a237a555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:18Z,use_quota=True,user_id='a0b7321b5d9e4078b1480b14048ff56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Creating volume 076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:18 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:18 devstack sudo[107168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 1073741824
Sep 08 16:54:18 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:18 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5.7fbcf7e4-a904-409d-b107-b7d491362a3b" returned: 0 in 0.280s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-7fbcf7e4-a904-409d-b107-b7d491362a3b" released by "_delete_snapshot" :: held 1.901s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-9afecb64-b911-4e1d-901b-1326e37abdc5" released by "delete_snapshot" :: held 1.938s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Created reservations ['f518edd0-8cd1-4ce3-a070-18eb62b7f940', '61e89491-1344-454b-85a2-c5c4bfa5a5f5', '7ef0acf2-e1e0-4444-9d3c-1e3432771e7b', 'a2b3d6dc-0507-4d9b-9190-35deac145499'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:18 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:54:18 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-32fee340-de19-47d1-9fb7-b24d23e71e4f tempest-ProjectMemberTests-1709291775 None] Lock "cinder-7fbcf7e4-a904-409d-b107-b7d491362a3b-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:19 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 1073741824" returned: 0 in 0.513s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-9afecb64-b911-4e1d-901b-1326e37abdc5-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:19 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2
Sep 08 16:54:19 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-9afecb64-b911-4e1d-901b-1326e37abdc5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-9afecb64-b911-4e1d-901b-1326e37abdc5" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-9afecb64-b911-4e1d-901b-1326e37abdc5" acquired by "delete_volume" :: waited 0.028s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4cd38d-d260-4334-b3e0-93fb82a38930]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:19 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2" returned: 0 in 0.330s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:19 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bee68010-290c-4bf5-9cf6-12085ef5dd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-076f9248-f18d-43bb-af2b-5846384423d2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:19 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32c058c-f090-42bf-bd66-25e8c5628c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:19 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Volume volume-076f9248-f18d-43bb-af2b-5846384423d2 (076f9248-f18d-43bb-af2b-5846384423d2): created successfully
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32c058c-f090-42bf-bd66-25e8c5628c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Flow 'volume_create_manager' (24fb1e58-98ea-4a8a-8efd-f42687bb3de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-336a429b-8545-4f4e-bb32-4a3c73923994 tempest-SnapshotDependencyTests-1435718824 None] Created volume successfully.
Sep 08 16:54:19 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5" returned: 0 in 0.452s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:19 devstack sudo[107183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5
Sep 08 16:54:19 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:20 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-9afecb64-b911-4e1d-901b-1326e37abdc5" returned: 0 in 0.305s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-9afecb64-b911-4e1d-901b-1326e37abdc5" released by "delete_volume" :: held 0.841s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Created reservations ['3c8df83a-2d37-46ee-96e3-6012751ffb11', '3c9d0354-156b-462e-a28d-6a5a8e4edba0', '74b38887-66b7-4eb2-acbc-3cf41edc6e9f', 'c44fb7e1-8294-4bdf-aa2d-1e2d5c6f5964'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:20 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:20 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:20 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.326s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:20 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-99db3420-c80a-4caa-bdb2-e0fb1b4a5990 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-9afecb64-b911-4e1d-901b-1326e37abdc5-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Flow 'volume_create_manager' (772d5b94-91cf-45f4-a254-98e3dc69c034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80f8af5-df21-4178-9078-416e4fea881f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80f8af5-df21-4178-9078-416e4fea881f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cf562b-e65d-4372-a4de-ec9c61692300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eecf888fb44b348604e8467a13c05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:21Z,use_quota=True,user_id='96dc1aa4d48a40dbaa673295a0d415a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54f0c77-77cb-412b-9a92-2958cc98ee1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54f0c77-77cb-412b-9a92-2958cc98ee1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe710e5-13a3-482e-83f9-4d1a50bd6311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe710e5-13a3-482e-83f9-4d1a50bd6311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15cf562b-e65d-4372-a4de-ec9c61692300', 'volume_name': 'volume-15cf562b-e65d-4372-a4de-ec9c61692300', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83aab2a3-5ca1-4038-a70a-279db0d06d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83aab2a3-5ca1-4038-a70a-279db0d06d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e46b71-fd37-4bbc-a706-4a03e7bc8098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:20 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Volume 15cf562b-e65d-4372-a4de-ec9c61692300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15cf562b-e65d-4372-a4de-ec9c61692300', 'volume_size': 1}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15cf562b-e65d-4372-a4de-ec9c61692300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eecf888fb44b348604e8467a13c05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:21Z,use_quota=True,user_id='96dc1aa4d48a40dbaa673295a0d415a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Creating volume 15cf562b-e65d-4372-a4de-ec9c61692300 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:20 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:20 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300 1073741824
Sep 08 16:54:20 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (8bc1bded-51b4-42d9-93af-091d83bf71ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b5e55e-7907-4967-9d14-1db501f4cbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b5e55e-7907-4967-9d14-1db501f4cbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123738255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b562d8-5939-459a-9d7b-3ad0f7001902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:21Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60f57a0-6df6-4798-b137-ad327be0af6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60f57a0-6df6-4798-b137-ad327be0af6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf669f94-3a76-4587-9938-5945d47734ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf669f94-3a76-4587-9938-5945d47734ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b562d8-5939-459a-9d7b-3ad0f7001902', 'volume_name': 'volume-68b562d8-5939-459a-9d7b-3ad0f7001902', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1893c310-2243-4a5f-8af2-13260bd67cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1893c310-2243-4a5f-8af2-13260bd67cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc32fea0-fa0a-43c2-a295-78854016f7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Volume 68b562d8-5939-459a-9d7b-3ad0f7001902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b562d8-5939-459a-9d7b-3ad0f7001902', 'volume_size': 1}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:21 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300 1073741824" returned: 0 in 0.471s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:21 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300
Sep 08 16:54:21 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:21 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300" returned: 0 in 0.255s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.514s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Creating offline snapshot e0f1aab6-5686-48a4-8860-7e18f37bbca4 of volume 076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e46b71-fd37-4bbc-a706-4a03e7bc8098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15cf562b-e65d-4372-a4de-ec9c61692300', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185b8ed3-3d19-4d39-809a-679b2f0b3e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe79a7-77a7-4381-8d69-640cba903426]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:21 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Volume volume-15cf562b-e65d-4372-a4de-ec9c61692300 (15cf562b-e65d-4372-a4de-ec9c61692300): created successfully
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185b8ed3-3d19-4d39-809a-679b2f0b3e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:21 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Flow 'volume_create_manager' (772d5b94-91cf-45f4-a254-98e3dc69c034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5d252926-6586-4a37-b802-ba42c7fc259e tempest-CinderUnicodeTest-1316575811 None] Created volume successfully.
Sep 08 16:54:21 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2
Sep 08 16:54:21 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:22 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2" returned: 0 in 0.368s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:22 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 1G
Sep 08 16:54:22 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:22 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 1G" returned: 0 in 0.367s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076f9248-f18d-43bb-af2b-5846384423d2 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:22 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076f9248-f18d-43bb-af2b-5846384423d2 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4
Sep 08 16:54:22 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:22 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-076f9248-f18d-43bb-af2b-5846384423d2 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4" returned: 0 in 0.285s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:22 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 is being set with open permissions: ugo+rw
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:22 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4
Sep 08 16:54:22 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:22 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:23 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.info
Sep 08 16:54:23 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Flow 'volume_create_manager' (27e5fb94-7358-44ec-af03-173b21d6dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba57f5f-df50-4cf5-a049-3585ca57ec71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bba57f5f-df50-4cf5-a049-3585ca57ec71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-806578869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fefb1e9-1399-48f8-baac-46fb9868e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eecf888fb44b348604e8467a13c05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:23Z,use_quota=True,user_id='96dc1aa4d48a40dbaa673295a0d415a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b96363-dea6-4310-9df3-0a0288f75abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:23 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b96363-dea6-4310-9df3-0a0288f75abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b9e5c-cf4e-43f7-9b02-e08cb29ec226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87b9e5c-cf4e-43f7-9b02-e08cb29ec226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fefb1e9-1399-48f8-baac-46fb9868e672', 'volume_name': 'volume-2fefb1e9-1399-48f8-baac-46fb9868e672', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f50addf-c5fc-42fa-b8fc-b0a56a6b7eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f50addf-c5fc-42fa-b8fc-b0a56a6b7eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1eb6ce4-a627-4d95-86e7-41913edfad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:23 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Volume 2fefb1e9-1399-48f8-baac-46fb9868e672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fefb1e9-1399-48f8-baac-46fb9868e672', 'volume_size': 1}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.info" returned: 0 in 0.291s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:23 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.info is being set with open permissions: ugo+rw
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:23 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.info
Sep 08 16:54:23 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:23 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.info" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.313s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123738255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b562d8-5939-459a-9d7b-3ad0f7001902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:21Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Creating volume 68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:23 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:23 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 1073741824
Sep 08 16:54:23 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6c3523f0-fbb1-48e0-9955-f3917600b433 tempest-SnapshotDependencyTests-1435718824 None] Create snapshot completed successfully
Sep 08 16:54:23 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 1073741824" returned: 0 in 0.395s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:23 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902
Sep 08 16:54:23 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:24 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-806578869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fefb1e9-1399-48f8-baac-46fb9868e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04eecf888fb44b348604e8467a13c05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:23Z,use_quota=True,user_id='96dc1aa4d48a40dbaa673295a0d415a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Creating volume 2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:24 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc32fea0-fa0a-43c2-a295-78854016f7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b562d8-5939-459a-9d7b-3ad0f7001902', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161af53b-42ae-482e-844b-40c8bbba49de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:24 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 1073741824
Sep 08 16:54:24 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:24 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Volume volume-68b562d8-5939-459a-9d7b-3ad0f7001902 (68b562d8-5939-459a-9d7b-3ad0f7001902): created successfully
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (161af53b-42ae-482e-844b-40c8bbba49de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (8bc1bded-51b4-42d9-93af-091d83bf71ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:24 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e2d66099-9a98-489c-9832-198d4b75a1bb tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:54:24 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 1073741824" returned: 0 in 0.453s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Flow 'volume_create_manager' (60baa283-ef7f-43b5-9e6b-353d4446cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96d129d-ae5a-40c2-be59-900167629898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:24 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c96d129d-ae5a-40c2-be59-900167629898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1359ce8-90b7-4cfc-83e3-9423beca851e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbce3dfc85174d35a7ee72c7a237a555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0f1aab6-5686-48a4-8860-7e18f37bbca4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:25Z,use_quota=True,user_id='a0b7321b5d9e4078b1480b14048ff56f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:24 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9b0b4c-4c3c-442b-a8c0-f4f8b4d4ea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd9b0b4c-4c3c-442b-a8c0-f4f8b4d4ea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce49deb2-4a54-43c8-befd-f414db93f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce49deb2-4a54-43c8-befd-f414db93f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1359ce8-90b7-4cfc-83e3-9423beca851e', 'volume_name': 'volume-e1359ce8-90b7-4cfc-83e3-9423beca851e', 'volume_size': 1, 'snapshot_id': 'e0f1aab6-5686-48a4-8860-7e18f37bbca4'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2975a6-e4cd-44eb-929b-203ca680c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2975a6-e4cd-44eb-929b-203ca680c68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f906cd6-df90-4f7a-addc-9f4e3d6323d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:24 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Volume e1359ce8-90b7-4cfc-83e3-9423beca851e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1359ce8-90b7-4cfc-83e3-9423beca851e', 'volume_size': 1, 'snapshot_id': 'e0f1aab6-5686-48a4-8860-7e18f37bbca4'}
Sep 08 16:54:24 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:25 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.177s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-quobyte-e0f1aab6-5686-48a4-8860-7e18f37bbca4-e1359ce8-90b7-4cfc-83e3-9423beca851e" by "_create_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1eb6ce4-a627-4d95-86e7-41913edfad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fefb1e9-1399-48f8-baac-46fb9868e672', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aff1d6c-9bb9-4598-bdde-5c0bef728fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e0f1aab6-5686-48a4-8860-7e18f37bbca4-e1359ce8-90b7-4cfc-83e3-9423beca851e" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Creating volume e1359ce8-90b7-4cfc-83e3-9423beca851e from snapshot e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-quobyte-e1359ce8-90b7-4cfc-83e3-9423beca851e" by "_copy_volume_from_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:25 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Volume volume-2fefb1e9-1399-48f8-baac-46fb9868e672 (2fefb1e9-1399-48f8-baac-46fb9868e672): created successfully
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aff1d6c-9bb9-4598-bdde-5c0bef728fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Flow 'volume_create_manager' (27e5fb94-7358-44ec-af03-173b21d6dfce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e1359ce8-90b7-4cfc-83e3-9423beca851e" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] snapshot: e0f1aab6-5686-48a4-8860-7e18f37bbca4, volume: e1359ce8-90b7-4cfc-83e3-9423beca851e,  {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 08 16:54:25 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-504bf33b-a15c-4b8c-a4c4-4dd49eebe68b tempest-CinderUnicodeTest-1316575811 None] Created volume successfully.
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[a420c348-6d0a-46fd-98fb-e5f0fae6d63c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:25 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4
Sep 08 16:54:25 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:25 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4" returned: 0 in 0.420s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-076f9248-f18d-43bb-af2b-5846384423d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e97792-d619-4708-bcfa-7d7d7b4ba523]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:25 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2
Sep 08 16:54:25 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:25 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2" returned: 0 in 0.348s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Creating direct copy from snapshot {{(pid=87505) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG cinder.utils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Path /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e not found in is_blk_device check {{(pid=87505) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 08 16:54:25 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:25 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e
Sep 08 16:54:25 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:29 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e" returned: 0 in 3.824s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:29 devstack cinder-volume[87505]: DEBUG cinder.image.image_utils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Image conversion details: src /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2, size 1024.00 MB, duration 3.83 sec, destination /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e {{(pid=87505) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 08 16:54:29 devstack cinder-volume[87505]: INFO cinder.image.image_utils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Converted 1024.00 MB image at 267.70 MB/s
Sep 08 16:54:29 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e is being set with open permissions: ugo+rw
Sep 08 16:54:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:29 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e
Sep 08 16:54:29 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:29 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e1359ce8-90b7-4cfc-83e3-9423beca851e" released by "_copy_volume_from_snapshot" :: held 4.918s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e0f1aab6-5686-48a4-8860-7e18f37bbca4-e1359ce8-90b7-4cfc-83e3-9423beca851e" released by "_create_volume_from_snapshot" :: held 4.991s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.022s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.668s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot 4c003657-b057-4fea-bb84-d27fd3cea026 of volume 68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f906cd6-df90-4f7a-addc-9f4e3d6323d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1359ce8-90b7-4cfc-83e3-9423beca851e', 'volume_size': 1, 'snapshot_id': 'e0f1aab6-5686-48a4-8860-7e18f37bbca4'}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6213241-95d6-438b-bdc6-283052197c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9782fd7-574b-4e44-a4f3-e92a8a2d0528]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:30 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Volume volume-e1359ce8-90b7-4cfc-83e3-9423beca851e (e1359ce8-90b7-4cfc-83e3-9423beca851e): created successfully
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6213241-95d6-438b-bdc6-283052197c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Flow 'volume_create_manager' (60baa283-ef7f-43b5-9e6b-353d4446cac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:30 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c3add6da-b376-4803-8037-c09bfbfd3583 tempest-SnapshotDependencyTests-1435718824 None] Created volume successfully.
Sep 08 16:54:30 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902
Sep 08 16:54:30 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:30 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902" returned: 0 in 0.362s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:30 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 1G
Sep 08 16:54:30 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:30 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 1G" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b562d8-5939-459a-9d7b-3ad0f7001902 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:30 devstack sudo[107277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b562d8-5939-459a-9d7b-3ad0f7001902 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026
Sep 08 16:54:30 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:31 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b562d8-5939-459a-9d7b-3ad0f7001902 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026" returned: 0 in 0.262s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:31 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 is being set with open permissions: ugo+rw
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:31 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026
Sep 08 16:54:31 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-e0f1aab6-5686-48a4-8860-7e18f37bbca4-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-e0f1aab6-5686-48a4-8860-7e18f37bbca4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-quobyte-076f9248-f18d-43bb-af2b-5846384423d2" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-076f9248-f18d-43bb-af2b-5846384423d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-quobyte-e0f1aab6-5686-48a4-8860-7e18f37bbca4" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e0f1aab6-5686-48a4-8860-7e18f37bbca4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Deleting offline snapshot e0f1aab6-5686-48a4-8860-7e18f37bbca4 of volume 076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] snapshot_file for this snap is: volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ebbed8-4c75-4981-8aa9-c8f383652626]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:31 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026" returned: 0 in 0.254s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:31 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.info
Sep 08 16:54:31 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:31 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4
Sep 08 16:54:31 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:31 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.info" returned: 0 in 0.256s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:31 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.info is being set with open permissions: ugo+rw
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:31 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.info
Sep 08 16:54:31 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:31 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4" returned: 0 in 0.392s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-076f9248-f18d-43bb-af2b-5846384423d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f6d0c-515b-4a1b-8f50-73209caaf399]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:31 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2
Sep 08 16:54:31 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:31 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.info" returned: 0 in 0.257s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.363s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Creating offline snapshot ef1c8d35-46dc-437e-84b6-45ba56ff9969 of volume 2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-15819590-3a7e-4438-99ee-ef17446c91f5 tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d47eca-1d0b-4bf4-afb8-af1bdc33894b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:32 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672
Sep 08 16:54:32 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:32 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2" returned: 0 in 0.547s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:32 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4
Sep 08 16:54:32 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:32 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672" returned: 0 in 0.364s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:32 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 1G
Sep 08 16:54:32 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:32 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4" returned: 0 in 0.319s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:32 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4
Sep 08 16:54:32 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:32 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 1G" returned: 0 in 0.396s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fefb1e9-1399-48f8-baac-46fb9868e672 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:32 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fefb1e9-1399-48f8-baac-46fb9868e672 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969
Sep 08 16:54:32 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-4c003657-b057-4fea-bb84-d27fd3cea026-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-4c003657-b057-4fea-bb84-d27fd3cea026-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-68b562d8-5939-459a-9d7b-3ad0f7001902" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-68b562d8-5939-459a-9d7b-3ad0f7001902" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-4c003657-b057-4fea-bb84-d27fd3cea026" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-4c003657-b057-4fea-bb84-d27fd3cea026" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot 4c003657-b057-4fea-bb84-d27fd3cea026 of volume 68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:32 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2.e0f1aab6-5686-48a4-8860-7e18f37bbca4" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e1228-d06e-4e75-9daa-876f9c729f59]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e0f1aab6-5686-48a4-8860-7e18f37bbca4" released by "_delete_snapshot" :: held 1.687s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-076f9248-f18d-43bb-af2b-5846384423d2" released by "delete_snapshot" :: held 1.709s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Created reservations ['df488ad4-b361-429e-b74d-585d04db5e08', 'c1ab695c-e2f3-46d2-a26c-c2ddde24f001', '7992dbb5-a488-4b66-9dde-9e725d4210d9', '49a55cc8-5ef4-41f7-89ca-32294998dfbe'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:33 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fefb1e9-1399-48f8-baac-46fb9868e672 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:33 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 is being set with open permissions: ugo+rw
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:33 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026
Sep 08 16:54:33 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:33 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969
Sep 08 16:54:33 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:33 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Delete snapshot completed successfully.
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2e4db426-a097-47b1-ae59-02ef10d5689d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-e0f1aab6-5686-48a4-8860-7e18f37bbca4-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:33 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:33 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026" returned: 0 in 0.388s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b562d8-5939-459a-9d7b-3ad0f7001902(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:33 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.info
Sep 08 16:54:33 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a22e5-636f-48bb-8919-f58c2fd7518c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-076f9248-f18d-43bb-af2b-5846384423d2-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-076f9248-f18d-43bb-af2b-5846384423d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-quobyte-076f9248-f18d-43bb-af2b-5846384423d2" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-076f9248-f18d-43bb-af2b-5846384423d2" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:33 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902
Sep 08 16:54:33 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3698ae36-98bc-450e-af1a-1f5e5faf16ac]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:33 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.info" returned: 0 in 0.266s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:33 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.info is being set with open permissions: ugo+rw
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:33 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2
Sep 08 16:54:33 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.info
Sep 08 16:54:33 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:33 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:33 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902" returned: 0 in 0.390s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:33 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026
Sep 08 16:54:33 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:33 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.info" returned: 0 in 0.266s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:33 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2" returned: 0 in 0.385s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:33 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2
Sep 08 16:54:33 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-73017e4d-5423-48f3-8eb8-8728f3307ed7 tempest-CinderUnicodeTest-1316575811 None] Create snapshot completed successfully
Sep 08 16:54:33 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:34 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026" returned: 0 in 0.352s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:34 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026
Sep 08 16:54:34 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:34 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-076f9248-f18d-43bb-af2b-5846384423d2" returned: 0 in 0.257s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-076f9248-f18d-43bb-af2b-5846384423d2" released by "delete_volume" :: held 0.697s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Created reservations ['7b6935e4-deca-4bfb-a322-14f03b5ff2e2', 'b11e71d1-2fcb-4055-b829-42e44b048f77', 'd9c1237c-ea2c-450a-ade3-ebddcf10724d', '2bc24bf0-9aeb-47de-a56c-f577d394a840'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:34 devstack sudo[107364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:34 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:34 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902.4c003657-b057-4fea-bb84-d27fd3cea026" returned: 0 in 0.240s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-4c003657-b057-4fea-bb84-d27fd3cea026" released by "_delete_snapshot" :: held 1.500s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-68b562d8-5939-459a-9d7b-3ad0f7001902" released by "delete_snapshot" :: held 1.528s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Created reservations ['417c61cb-d883-4345-ad5a-72bf763293e7', '6b447f1b-c575-4fda-b637-4d6bb4b864d2', 'a973ef23-a537-4845-883d-af3eb5ba7e44', '58889170-0d6e-4336-b718-ebc830ec3f89'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-01ef3a31-5a30-4794-91cd-a977497d70b2 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-4c003657-b057-4fea-bb84-d27fd3cea026-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:34 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.255s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Deleted volume successfully.
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-35dc75ec-abf3-4bba-a74c-9139a0197213 tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-076f9248-f18d-43bb-af2b-5846384423d2-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-e1359ce8-90b7-4cfc-83e3-9423beca851e-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-e1359ce8-90b7-4cfc-83e3-9423beca851e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "cinder-quobyte-e1359ce8-90b7-4cfc-83e3-9423beca851e" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e1359ce8-90b7-4cfc-83e3-9423beca851e" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd00b964-fb4f-4709-80ea-8f7b1986204e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:34 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e
Sep 08 16:54:34 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-68b562d8-5939-459a-9d7b-3ad0f7001902-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:35 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e" returned: 0 in 0.363s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Lock "cinder-68b562d8-5939-459a-9d7b-3ad0f7001902-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "cinder-ef1c8d35-46dc-437e-84b6-45ba56ff9969-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:35 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e
Sep 08 16:54:35 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-ef1c8d35-46dc-437e-84b6-45ba56ff9969-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "cinder-quobyte-2fefb1e9-1399-48f8-baac-46fb9868e672" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-68b562d8-5939-459a-9d7b-3ad0f7001902" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-2fefb1e9-1399-48f8-baac-46fb9868e672" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "cinder-quobyte-ef1c8d35-46dc-437e-84b6-45ba56ff9969" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-68b562d8-5939-459a-9d7b-3ad0f7001902" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-ef1c8d35-46dc-437e-84b6-45ba56ff9969" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Deleting offline snapshot ef1c8d35-46dc-437e-84b6-45ba56ff9969 of volume 2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] snapshot_file for this snap is: volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b33dd1b-90f8-489d-a2ef-4ca48213ffaa]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e89958-570b-4e4b-9989-5c9ee22d493f]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:35 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902
Sep 08 16:54:35 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:35 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-e1359ce8-90b7-4cfc-83e3-9423beca851e" returned: 0 in 0.304s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:35 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969
Sep 08 16:54:35 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-quobyte-e1359ce8-90b7-4cfc-83e3-9423beca851e" released by "delete_volume" :: held 0.705s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Created reservations ['82fde2ee-bd71-4bc0-90d2-0661fefb6e4e', '36795475-0064-4a11-be5d-0f9d4e5a86b6', '2d51a1b3-4ab9-4aba-a263-1dcd42662d91', '6b31e264-4bc3-4ba3-9421-17b4a297a178'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:35 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:35 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:35 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902" returned: 0 in 0.375s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:35 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969" returned: 0 in 0.383s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fefb1e9-1399-48f8-baac-46fb9868e672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:35 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902
Sep 08 16:54:35 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6015d31-77a6-476c-b41f-04c22f9e0a1e]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:35 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672
Sep 08 16:54:35 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:35 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.286s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:35 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Deleted volume successfully.
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5eab8708-b9fe-40b3-900b-475ffb7c5c8d tempest-SnapshotDependencyTests-1435718824 None] Lock "cinder-e1359ce8-90b7-4cfc-83e3-9423beca851e-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:35 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-68b562d8-5939-459a-9d7b-3ad0f7001902" returned: 0 in 0.288s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-68b562d8-5939-459a-9d7b-3ad0f7001902" released by "delete_volume" :: held 0.749s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:35 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Created reservations ['4e7bbb1a-f08d-46f1-a901-f6b3f8779088', 'dae6a54e-08d0-4e91-ae17-49d7141e511c', '032dd0ad-6300-46f1-a7dc-69d7c2aae8bb', 'd73811bd-3484-48e9-a6a1-b9d22ca893c4'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:36 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672" returned: 0 in 0.439s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:36 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:36 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:36 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969
Sep 08 16:54:36 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:36 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.272s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-2d340a72-eaa8-4a2f-b132-30205017e0cf tempest-ProjectMemberTests-1709291775 None] Lock "cinder-68b562d8-5939-459a-9d7b-3ad0f7001902-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:36 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969" returned: 0 in 0.439s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:36 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969
Sep 08 16:54:36 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (a024a3f6-9ef6-4500-8ee5-afeff1571df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59b1f92-4b98-420f-9ba0-2781b317d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59b1f92-4b98-420f-9ba0-2781b317d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482342947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6b9ee9-4225-47a6-b30d-0011132d005a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:37Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42db2646-2304-43e1-95fd-7ffbc21d087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42db2646-2304-43e1-95fd-7ffbc21d087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7930848-b837-4899-83b3-48787ea1beba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7930848-b837-4899-83b3-48787ea1beba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6b9ee9-4225-47a6-b30d-0011132d005a', 'volume_name': 'volume-ee6b9ee9-4225-47a6-b30d-0011132d005a', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d702e1-29d0-454c-b334-2de8e403a977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:36 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d702e1-29d0-454c-b334-2de8e403a977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c9ab14-a995-4bcf-a004-dd9c9ee2d58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:36 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Volume ee6b9ee9-4225-47a6-b30d-0011132d005a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6b9ee9-4225-47a6-b30d-0011132d005a', 'volume_size': 1}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-482342947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6b9ee9-4225-47a6-b30d-0011132d005a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:37Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Creating volume ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:36 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672.ef1c8d35-46dc-437e-84b6-45ba56ff9969" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:36 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a 1073741824
Sep 08 16:54:36 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-ef1c8d35-46dc-437e-84b6-45ba56ff9969" released by "_delete_snapshot" :: held 1.749s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-2fefb1e9-1399-48f8-baac-46fb9868e672" released by "delete_snapshot" :: held 1.808s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:36 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Created reservations ['39e53a83-56c3-4a11-8b66-803cd457dc13', '76ad9004-0ce9-4af8-9fac-056bc76617aa', '293eae46-9df6-4c8c-83c2-eb1ed7021940', 'b3fe425e-31f4-45e4-91eb-74f56a21fdb5'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Delete snapshot completed successfully.
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-8d896118-aa34-46ca-adfb-6410f75dc94e tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-ef1c8d35-46dc-437e-84b6-45ba56ff9969-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "cinder-2fefb1e9-1399-48f8-baac-46fb9868e672-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-2fefb1e9-1399-48f8-baac-46fb9868e672-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "cinder-quobyte-2fefb1e9-1399-48f8-baac-46fb9868e672" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-2fefb1e9-1399-48f8-baac-46fb9868e672" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:37 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a 1073741824" returned: 0 in 0.500s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[610b70dd-8f68-4896-bbdb-f8f8ea711b26]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:37 devstack sudo[107420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a
Sep 08 16:54:37 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:37 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672
Sep 08 16:54:37 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:37 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a" returned: 0 in 0.283s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c9ab14-a995-4bcf-a004-dd9c9ee2d58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6b9ee9-4225-47a6-b30d-0011132d005a', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76da088-88dd-4e42-8cf4-e7a86e4ed46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:37 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Volume volume-ee6b9ee9-4225-47a6-b30d-0011132d005a (ee6b9ee9-4225-47a6-b30d-0011132d005a): created successfully
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76da088-88dd-4e42-8cf4-e7a86e4ed46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (a024a3f6-9ef6-4500-8ee5-afeff1571df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:37 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c98a7d7a-c480-4243-8dba-1b30bab5e246 tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:54:37 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672" returned: 0 in 0.414s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:37 devstack sudo[107429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672
Sep 08 16:54:37 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:38 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2fefb1e9-1399-48f8-baac-46fb9868e672" returned: 0 in 0.253s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-2fefb1e9-1399-48f8-baac-46fb9868e672" released by "delete_volume" :: held 0.732s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Created reservations ['80e1d8c7-2a47-453b-a91b-fc6625c87b74', '18b92279-c0a0-4c4e-9fa7-fbef174d481d', '21cc5c6d-452e-424d-96dc-22b5a92823d6', '29fa38f3-33a0-458a-9257-00cbcf2a1036'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:38 devstack sudo[107432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:38 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:38 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "cinder-15cf562b-e65d-4372-a4de-ec9c61692300-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Deleted volume successfully.
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bab79c82-77f6-42fe-b107-f467000ee654 tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-2fefb1e9-1399-48f8-baac-46fb9868e672-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-15cf562b-e65d-4372-a4de-ec9c61692300-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "cinder-quobyte-15cf562b-e65d-4372-a4de-ec9c61692300" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-15cf562b-e65d-4372-a4de-ec9c61692300" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dba5ddf-ed24-47e7-96cb-1f8d5dbb817c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:38 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300
Sep 08 16:54:38 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:38 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300" returned: 0 in 0.398s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot e1628911-9db1-4dc9-bf6c-f4d1e4e46498 of volume ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:39 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300
Sep 08 16:54:39 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae90315b-a48b-47c5-9819-ce4823950da3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:39 devstack sudo[107442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a
Sep 08 16:54:39 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:39 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-15cf562b-e65d-4372-a4de-ec9c61692300" returned: 0 in 0.248s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-quobyte-15cf562b-e65d-4372-a4de-ec9c61692300" released by "delete_volume" :: held 0.688s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Created reservations ['f04094c2-a603-45d8-85ad-b143fa6f8223', 'ed5d788d-3cef-4f15-bee9-e87dbeb07857', 'e68b4801-6cca-415f-9b44-0fd491a6d555', 'bbbdb98b-e537-49c4-86eb-6feabea4915c'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:39 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a" returned: 0 in 0.378s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:39 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:39 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:39 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 1G
Sep 08 16:54:39 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:39 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.361s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:39 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Deleted volume successfully.
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ef06d406-5112-4f76-89d1-2cc363a208dd tempest-CinderUnicodeTest-1316575811 None] Lock "cinder-15cf562b-e65d-4372-a4de-ec9c61692300-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:39 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 1G" returned: 0 in 0.547s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee6b9ee9-4225-47a6-b30d-0011132d005a -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:39 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee6b9ee9-4225-47a6-b30d-0011132d005a -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498
Sep 08 16:54:39 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:40 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee6b9ee9-4225-47a6-b30d-0011132d005a -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498" returned: 0 in 0.288s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:40 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 is being set with open permissions: ugo+rw
Sep 08 16:54:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:40 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498
Sep 08 16:54:40 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:40 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498" returned: 0 in 0.310s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:40 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.info
Sep 08 16:54:40 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:40 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.info" returned: 0 in 0.280s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:40 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.info is being set with open permissions: ugo+rw
Sep 08 16:54:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:40 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.info
Sep 08 16:54:40 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:41 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.info" returned: 0 in 0.334s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-2c0435b9-48cb-4668-9c88-f6ca10078d07 tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-e1628911-9db1-4dc9-bf6c-f4d1e4e46498-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-e1628911-9db1-4dc9-bf6c-f4d1e4e46498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-ee6b9ee9-4225-47a6-b30d-0011132d005a" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-ee6b9ee9-4225-47a6-b30d-0011132d005a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-e1628911-9db1-4dc9-bf6c-f4d1e4e46498" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-e1628911-9db1-4dc9-bf6c-f4d1e4e46498" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot e1628911-9db1-4dc9-bf6c-f4d1e4e46498 of volume ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d4a74a-b3db-4c10-bd89-4ad837b2ef4b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:42 devstack sudo[107473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498
Sep 08 16:54:42 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:42 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498" returned: 0 in 0.414s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee6b9ee9-4225-47a6-b30d-0011132d005a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3068fa1-9183-49f6-9f77-b4c0912071df]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:42 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a
Sep 08 16:54:42 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e5d5c60f-d947-40dd-91bb-0bb980c79532 tempest-ProjectAdminTests-699451752 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5176582336426, 'free_capacity_gb': 1773.5176582336426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87505) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 08 16:54:43 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a" returned: 0 in 0.452s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:43 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498
Sep 08 16:54:43 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:43 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498" returned: 0 in 0.361s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:43 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498
Sep 08 16:54:43 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:43 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a.e1628911-9db1-4dc9-bf6c-f4d1e4e46498" returned: 0 in 0.246s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-e1628911-9db1-4dc9-bf6c-f4d1e4e46498" released by "_delete_snapshot" :: held 1.578s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-ee6b9ee9-4225-47a6-b30d-0011132d005a" released by "delete_snapshot" :: held 1.605s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:43 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Created reservations ['903233c0-b3d3-4024-a9dd-863ec3e34fce', 'd77fb04e-b65e-41e3-984b-920c34bc8e8c', 'a30510c6-6a0a-492b-b600-0e42f5bbf65a', '8d66139c-053a-4055-b775-8dc94bfac607'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:43 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-5c6eacb3-628c-4d26-b445-481a6351c795 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-e1628911-9db1-4dc9-bf6c-f4d1e4e46498-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-ee6b9ee9-4225-47a6-b30d-0011132d005a-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-ee6b9ee9-4225-47a6-b30d-0011132d005a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-ee6b9ee9-4225-47a6-b30d-0011132d005a" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-ee6b9ee9-4225-47a6-b30d-0011132d005a" acquired by "delete_volume" :: waited 0.024s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[01175957-1c9d-4be1-91a8-ac78a11017d7]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:44 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a
Sep 08 16:54:44 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:44 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a" returned: 0 in 0.391s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:44 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a
Sep 08 16:54:44 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:45 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-ee6b9ee9-4225-47a6-b30d-0011132d005a" returned: 0 in 0.278s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-ee6b9ee9-4225-47a6-b30d-0011132d005a" released by "delete_volume" :: held 0.748s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Created reservations ['66fd812c-1569-403b-aaea-202c0ecd8586', '791d6669-9636-48fa-a406-e73f2c5a50f4', 'd4f05ac6-4de4-4713-8808-b14a201e9a06', 'd131ef5d-ffd1-4c09-a9cc-46c034d8622f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:45 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:45 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:45 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.301s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:45 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:54:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-af4a2a0b-1ee6-49ed-a399-6f24acfcd0e0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-ee6b9ee9-4225-47a6-b30d-0011132d005a-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (068c67eb-aed1-40b3-bb26-d0551bb88f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2a24e8-497f-4db4-929c-cc5bed1dd460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2a24e8-497f-4db4-929c-cc5bed1dd460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577149576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1659e2c4-a29b-4bc5-94b1-00e1b3540f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:46Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276e822e-9c35-4f3d-a2e3-e908b3df7255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276e822e-9c35-4f3d-a2e3-e908b3df7255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b9cdf6-bf5c-46dd-81fb-2c7b962d3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b9cdf6-bf5c-46dd-81fb-2c7b962d3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1659e2c4-a29b-4bc5-94b1-00e1b3540f63', 'volume_name': 'volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43216571-efda-41ac-8801-5355c31eb65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43216571-efda-41ac-8801-5355c31eb65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d4ffd8-e059-4500-939d-0c86afc2238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:46 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Volume 1659e2c4-a29b-4bc5-94b1-00e1b3540f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63', 'volume_size': 1}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577149576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1659e2c4-a29b-4bc5-94b1-00e1b3540f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:46Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Creating volume 1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:46 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:46 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 1073741824
Sep 08 16:54:46 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:46 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 1073741824" returned: 0 in 0.481s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:46 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63
Sep 08 16:54:46 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:47 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" returned: 0 in 0.321s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d4ffd8-e059-4500-939d-0c86afc2238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb0553e-ad30-4164-aed4-09579df9cb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:47 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Volume volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 (1659e2c4-a29b-4bc5-94b1-00e1b3540f63): created successfully
Sep 08 16:54:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb0553e-ad30-4164-aed4-09579df9cb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (068c67eb-aed1-40b3-bb26-d0551bb88f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:47 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0dfe20bf-c952-469d-b43f-dfe6bd5805a6 tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:54:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot 6a089164-ec86-4bf3-83cb-51e133169ea8 of volume 1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:48 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f648279e-98e5-4971-982a-4de8d0d2d2d0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:48 devstack sudo[107514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63
Sep 08 16:54:48 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:48 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" returned: 0 in 0.385s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:48 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 1G
Sep 08 16:54:48 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:49 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 1G" returned: 0 in 0.455s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:49 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8
Sep 08 16:54:49 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:49 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8" returned: 0 in 0.323s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:49 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 is being set with open permissions: ugo+rw
Sep 08 16:54:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:49 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8
Sep 08 16:54:49 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:49 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8" returned: 0 in 0.322s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:50 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.info
Sep 08 16:54:50 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:50 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.info" returned: 0 in 0.291s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:50 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.info is being set with open permissions: ugo+rw
Sep 08 16:54:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:50 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.info
Sep 08 16:54:50 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:50 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.info" returned: 0 in 0.259s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-59e8d516-3216-4654-868c-0257bf0e837a tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-6a089164-ec86-4bf3-83cb-51e133169ea8-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Lock "cinder-6a089164-ec86-4bf3-83cb-51e133169ea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-6a089164-ec86-4bf3-83cb-51e133169ea8" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-6a089164-ec86-4bf3-83cb-51e133169ea8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot 6a089164-ec86-4bf3-83cb-51e133169ea8 of volume 1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab680a8-c574-4713-a9cd-6c0fdf6b1246]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:51 devstack sudo[107540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8
Sep 08 16:54:51 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:52 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8" returned: 0 in 0.355s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb73e586-fa7a-47a9-84ca-195d5ea1da0a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:52 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63
Sep 08 16:54:52 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:52 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" returned: 0 in 0.365s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:52 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8
Sep 08 16:54:52 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:52 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:52 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8
Sep 08 16:54:52 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:53 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63.6a089164-ec86-4bf3-83cb-51e133169ea8" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-6a089164-ec86-4bf3-83cb-51e133169ea8" released by "_delete_snapshot" :: held 1.416s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" released by "delete_snapshot" :: held 1.439s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Created reservations ['eab94d18-0e2c-430c-aee3-24412146d7a7', '36398b48-6ec4-42ab-9f20-8fb40fe5b72e', '757b47b3-344f-45e7-91ea-1c0f78e3a00f', 'e8d2eb18-c83a-4013-aa1e-aadde97a8b6d'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:53 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-9cbbd439-a7e4-4cc9-b079-7ac6a41cb5aa tempest-ProjectMemberTests-1709291775 None] Lock "cinder-6a089164-ec86-4bf3-83cb-51e133169ea8-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-1659e2c4-a29b-4bc5-94b1-00e1b3540f63-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-1659e2c4-a29b-4bc5-94b1-00e1b3540f63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" acquired by "delete_volume" :: waited 0.025s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b0bda9-0b65-4639-98d9-6c05a8ea2020]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:54 devstack sudo[107559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63
Sep 08 16:54:54 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:54 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" returned: 0 in 0.371s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:54 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63
Sep 08 16:54:54 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:54 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" returned: 0 in 0.241s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-1659e2c4-a29b-4bc5-94b1-00e1b3540f63" released by "delete_volume" :: held 0.680s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Created reservations ['4f19ee90-c474-4b7f-9008-12202edd36d9', 'e9ec7701-4944-4930-8b02-8e936a0fd7be', 'd323dfc8-36bf-4d52-8a47-80efdc2a80ab', '89a3f061-82ce-4d77-ab86-7c0e4db15593'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:54 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:54 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:54 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.265s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:54:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e092f71d-15e6-47f6-9fd0-2dd191549f24 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-1659e2c4-a29b-4bc5-94b1-00e1b3540f63-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (2d0ff023-e444-4ff0-9298-97b8ce34a0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7163e276-c186-4628-9cdd-7aaa46e43412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7163e276-c186-4628-9cdd-7aaa46e43412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121841376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aa1d1e-d21f-4875-921a-9b8684135bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:55Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8c1a32-4f88-4a24-8c02-7ce7183b0c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8c1a32-4f88-4a24-8c02-7ce7183b0c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00a5b16-0621-4ac5-8552-fab4032b1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00a5b16-0621-4ac5-8552-fab4032b1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81aa1d1e-d21f-4875-921a-9b8684135bf0', 'volume_name': 'volume-81aa1d1e-d21f-4875-921a-9b8684135bf0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5869c2ef-f07c-45a3-bf98-682d5862accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5869c2ef-f07c-45a3-bf98-682d5862accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bedc8c-a5fc-48c8-96f7-5a26fabcf580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Volume 81aa1d1e-d21f-4875-921a-9b8684135bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81aa1d1e-d21f-4875-921a-9b8684135bf0', 'volume_size': 1}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-121841376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aa1d1e-d21f-4875-921a-9b8684135bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:54:55Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Creating volume 81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:54:55 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:55 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 1073741824
Sep 08 16:54:55 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:55 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 1073741824" returned: 0 in 0.429s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:55 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0
Sep 08 16:54:55 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:56 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53bedc8c-a5fc-48c8-96f7-5a26fabcf580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81aa1d1e-d21f-4875-921a-9b8684135bf0', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6c24ef-8ac0-4792-8832-e007a2bb6e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:54:56 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Volume volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 (81aa1d1e-d21f-4875-921a-9b8684135bf0): created successfully
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6c24ef-8ac0-4792-8832-e007a2bb6e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (2d0ff023-e444-4ff0-9298-97b8ce34a0e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:54:56 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9b0001d1-74f3-40c0-9428-6d05d6fd0014 tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:54:56 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:54:56 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot c33d54b7-9af7-459f-9f49-b397fd150fe9 of volume 81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2385b9-cf43-4bb7-a209-89577080d285]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:56 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0
Sep 08 16:54:56 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:56 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.244s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:54:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:54:57 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0" returned: 0 in 0.375s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:57 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 1G
Sep 08 16:54:57 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:57 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 1G" returned: 0 in 0.361s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:57 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9
Sep 08 16:54:57 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:57 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9" returned: 0 in 0.289s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:57 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 is being set with open permissions: ugo+rw
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:57 devstack sudo[107599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9
Sep 08 16:54:57 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:57 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9" returned: 0 in 0.259s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:58 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.info
Sep 08 16:54:58 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:58 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.info" returned: 0 in 0.262s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:58 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.info is being set with open permissions: ugo+rw
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:58 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.info
Sep 08 16:54:58 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:58 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.info" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:54:58 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-8a1f4791-b153-46a1-924f-898ff7dcd93e tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-c33d54b7-9af7-459f-9f49-b397fd150fe9-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-c33d54b7-9af7-459f-9f49-b397fd150fe9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-81aa1d1e-d21f-4875-921a-9b8684135bf0" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-81aa1d1e-d21f-4875-921a-9b8684135bf0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-c33d54b7-9af7-459f-9f49-b397fd150fe9" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-c33d54b7-9af7-459f-9f49-b397fd150fe9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot c33d54b7-9af7-459f-9f49-b397fd150fe9 of volume 81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a538d-179f-46e3-8e4b-02754ff6c1bf]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:58 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9
Sep 08 16:54:58 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:59 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9" returned: 0 in 0.358s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81aa1d1e-d21f-4875-921a-9b8684135bf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f513ea-9722-4df5-848e-84100d0b15be]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:59 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0
Sep 08 16:54:59 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:59 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0" returned: 0 in 0.361s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:59 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9
Sep 08 16:54:59 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:54:59 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9" returned: 0 in 0.359s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:54:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:54:59 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9
Sep 08 16:54:59 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:00 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0.c33d54b7-9af7-459f-9f49-b397fd150fe9" returned: 0 in 0.309s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-c33d54b7-9af7-459f-9f49-b397fd150fe9" released by "_delete_snapshot" :: held 1.497s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-81aa1d1e-d21f-4875-921a-9b8684135bf0" released by "delete_snapshot" :: held 1.521s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Created reservations ['42f46093-cb74-4be0-86bc-bcc5ad21f61b', 'ff14c609-ac10-4764-bcf9-a08bdf2dcae8', '268e2047-0fbf-4750-a27a-d4a102818f87', 'de05ecec-e194-4b4b-ac9a-273bbd27ef66'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-66226aac-5068-4fe3-ab9a-5d6d526e4495 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-c33d54b7-9af7-459f-9f49-b397fd150fe9-delete_snapshot" released by "delete_snapshot" :: held 1.716s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-81aa1d1e-d21f-4875-921a-9b8684135bf0-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-81aa1d1e-d21f-4875-921a-9b8684135bf0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-81aa1d1e-d21f-4875-921a-9b8684135bf0" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-81aa1d1e-d21f-4875-921a-9b8684135bf0" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[29be663a-3714-49a9-a936-fc9528a13eb4]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:01 devstack sudo[107994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0
Sep 08 16:55:01 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:01 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0" returned: 0 in 0.364s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:01 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0
Sep 08 16:55:01 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:01 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-81aa1d1e-d21f-4875-921a-9b8684135bf0" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-81aa1d1e-d21f-4875-921a-9b8684135bf0" released by "delete_volume" :: held 0.674s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Created reservations ['e0790d92-acc6-4246-bd56-03c0907c76bd', '5984ac27-d69a-4e33-8fe8-9b648759528d', '6b8c157c-b67f-417b-870b-38412b3e0310', 'b183e051-7ef2-4c62-b938-25a310189332'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:01 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:01 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:01 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:01 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:01 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6bc564e1-b1ea-41de-9737-27b39fc3868d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-81aa1d1e-d21f-4875-921a-9b8684135bf0-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (fb3f651a-d407-43e4-a971-733b302859a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5abbb0-34ce-4a96-9e26-bf5ef85c4295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5abbb0-34ce-4a96-9e26-bf5ef85c4295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278758005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eec9b4-4311-4abe-a45e-6a7dc66c781f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:02Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee40f7c4-7e34-44ea-af8c-6f4f929caf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee40f7c4-7e34-44ea-af8c-6f4f929caf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be92b1f7-8b33-4ba9-959d-9f8f416b0581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be92b1f7-8b33-4ba9-959d-9f8f416b0581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94eec9b4-4311-4abe-a45e-6a7dc66c781f', 'volume_name': 'volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b7756d-6546-4248-9870-af6189e0ea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b7756d-6546-4248-9870-af6189e0ea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5974f8-2ece-4ae2-aa61-0717609d169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:02 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Volume 94eec9b4-4311-4abe-a45e-6a7dc66c781f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f', 'volume_size': 1}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278758005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eec9b4-4311-4abe-a45e-6a7dc66c781f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:02Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Creating volume 94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:02 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:02 devstack sudo[108008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f 1073741824
Sep 08 16:55:02 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:02 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:02 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f 1073741824" returned: 0 in 0.455s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:03 devstack sudo[108014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f
Sep 08 16:55:03 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:03 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f" returned: 0 in 0.256s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5974f8-2ece-4ae2-aa61-0717609d169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a375a3-8a95-45a9-84d8-733da1959718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:03 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Volume volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f (94eec9b4-4311-4abe-a45e-6a7dc66c781f): created successfully
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a375a3-8a95-45a9-84d8-733da1959718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (fb3f651a-d407-43e4-a971-733b302859a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:03 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-5bb2da8a-9bcd-43d3-99c0-f60e1e8a40b1 tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot c3c16bbe-1648-4dba-8a62-f0ea02642abe of volume 94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f326760-62e3-4273-8449-e09582406709]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:03 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:03 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f
Sep 08 16:55:03 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:04 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f" returned: 0 in 0.378s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:04 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe 1G
Sep 08 16:55:04 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:04 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe 1G" returned: 0 in 0.397s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:04 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe
Sep 08 16:55:04 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:04 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe" returned: 0 in 0.298s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:04 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe is being set with open permissions: ugo+rw
Sep 08 16:55:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:04 devstack sudo[108033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe
Sep 08 16:55:04 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:05 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe" returned: 0 in 0.266s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:05 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.info
Sep 08 16:55:05 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:05 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.info" returned: 0 in 0.251s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:05 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.info is being set with open permissions: ugo+rw
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:05 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.info
Sep 08 16:55:05 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:05 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.info" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-db72db16-f840-4236-ad0a-81fb075a16d0 tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-c3c16bbe-1648-4dba-8a62-f0ea02642abe-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-c3c16bbe-1648-4dba-8a62-f0ea02642abe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-94eec9b4-4311-4abe-a45e-6a7dc66c781f" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-94eec9b4-4311-4abe-a45e-6a7dc66c781f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-c3c16bbe-1648-4dba-8a62-f0ea02642abe" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-c3c16bbe-1648-4dba-8a62-f0ea02642abe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot c3c16bbe-1648-4dba-8a62-f0ea02642abe of volume 94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[05628285-e0cf-4dce-8d45-4e50e9149840]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:05 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe
Sep 08 16:55:05 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:06 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe" returned: 0 in 0.382s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f876c1-cf12-4c1e-9b11-142deb11e26d]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:06 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f
Sep 08 16:55:06 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:06 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f" returned: 0 in 0.367s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:06 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe
Sep 08 16:55:06 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:06 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe" returned: 0 in 0.355s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:07 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe
Sep 08 16:55:07 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:07 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f.c3c16bbe-1648-4dba-8a62-f0ea02642abe" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-c3c16bbe-1648-4dba-8a62-f0ea02642abe" released by "_delete_snapshot" :: held 1.450s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-94eec9b4-4311-4abe-a45e-6a7dc66c781f" released by "delete_snapshot" :: held 1.475s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Created reservations ['69580d09-4563-4896-8a53-647d2157246c', 'fd55068b-b95e-4e7f-b5be-f8039797138d', 'a6e7175f-b92e-45e5-a3b6-3199f57cf46d', 'a634e936-d15e-4a7b-8a05-4d299ed1ead6'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:07 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0978df26-ded8-4cc7-85fd-a583221c11f4 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-c3c16bbe-1648-4dba-8a62-f0ea02642abe-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-94eec9b4-4311-4abe-a45e-6a7dc66c781f-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-94eec9b4-4311-4abe-a45e-6a7dc66c781f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:07 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-94eec9b4-4311-4abe-a45e-6a7dc66c781f" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-94eec9b4-4311-4abe-a45e-6a7dc66c781f" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee76e09-b3c4-4096-9ec2-2cb95bbfd3ee]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:08 devstack sudo[108062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f
Sep 08 16:55:08 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:08 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f" returned: 0 in 0.330s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:08 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f
Sep 08 16:55:08 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:08 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-94eec9b4-4311-4abe-a45e-6a7dc66c781f" returned: 0 in 0.229s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-94eec9b4-4311-4abe-a45e-6a7dc66c781f" released by "delete_volume" :: held 0.612s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Created reservations ['54444999-561f-41cb-b8f3-4f3496bfab45', 'ed58fc70-ce2c-4c50-8dd7-4684ba50652c', 'ce2dabce-e37f-48f7-a502-c60ce61bd52c', 'f7382e9f-0236-42e0-8a3f-edae900c7e12'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:08 devstack sudo[108070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:08 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:08 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:08 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:55:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-366a4ccf-3dbe-4e7f-a2b0-eedb246eb8b0 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-94eec9b4-4311-4abe-a45e-6a7dc66c781f-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (21c75b4d-a162-4f64-9fed-8a093e9cdf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44940db-1635-40f7-b65b-c4ec1d4c62bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44940db-1635-40f7-b65b-c4ec1d4c62bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708515129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ffd9eb-7eec-4d39-963e-eba90b92a449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:09Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10addf76-807f-4eb7-b8af-bd8ca813fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10addf76-807f-4eb7-b8af-bd8ca813fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d131977-f61f-44e6-a17f-1b98c058ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d131977-f61f-44e6-a17f-1b98c058ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ffd9eb-7eec-4d39-963e-eba90b92a449', 'volume_name': 'volume-73ffd9eb-7eec-4d39-963e-eba90b92a449', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e6d9da-2f9c-45c2-8070-74f00420d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05e6d9da-2f9c-45c2-8070-74f00420d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ef3530-1e9c-43a4-b93c-f5bd1a3ba08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:09 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Volume 73ffd9eb-7eec-4d39-963e-eba90b92a449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ffd9eb-7eec-4d39-963e-eba90b92a449', 'volume_size': 1}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708515129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ffd9eb-7eec-4d39-963e-eba90b92a449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:09Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Creating volume 73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:09 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:09 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 1073741824
Sep 08 16:55:09 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:09 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 1073741824" returned: 0 in 0.389s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:10 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449
Sep 08 16:55:10 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:10 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ef3530-1e9c-43a4-b93c-f5bd1a3ba08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ffd9eb-7eec-4d39-963e-eba90b92a449', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7154419d-c9e1-48cd-ad78-4a711718523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=167,cinder:INSERT=47,cinder:UPDATE=185,cinder:DELETE=10 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:55:10 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Volume volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 (73ffd9eb-7eec-4d39-963e-eba90b92a449): created successfully
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7154419d-c9e1-48cd-ad78-4a711718523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (21c75b4d-a162-4f64-9fed-8a093e9cdf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d904c7b7-0ea8-471c-a61d-056929958ba5 tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot 704199ab-bef8-493a-a47a-a6f03fd0ef17 of volume 73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f587f9-2471-466d-8f99-288eeceb2cc2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:10 devstack sudo[108087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449
Sep 08 16:55:10 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:11 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:11 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 1G
Sep 08 16:55:11 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:11 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 1G" returned: 0 in 0.364s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:11 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17
Sep 08 16:55:11 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:11 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17" returned: 0 in 0.280s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:11 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 is being set with open permissions: ugo+rw
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:11 devstack sudo[108102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17
Sep 08 16:55:11 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:11 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17" returned: 0 in 0.234s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=126,cinder:INSERT=54,cinder:UPDATE=190,cinder:DELETE=21 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:55:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:11 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.info
Sep 08 16:55:11 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:12 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.info" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:12 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.info is being set with open permissions: ugo+rw
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:12 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.info
Sep 08 16:55:12 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:12 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.info" returned: 0 in 0.227s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.772s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f1a5caf9-6867-41f1-9620-abc498c2b8fc tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-704199ab-bef8-493a-a47a-a6f03fd0ef17-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-704199ab-bef8-493a-a47a-a6f03fd0ef17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-73ffd9eb-7eec-4d39-963e-eba90b92a449" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-73ffd9eb-7eec-4d39-963e-eba90b92a449" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-704199ab-bef8-493a-a47a-a6f03fd0ef17" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-704199ab-bef8-493a-a47a-a6f03fd0ef17" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot 704199ab-bef8-493a-a47a-a6f03fd0ef17 of volume 73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d5faa-0e31-4490-ac7e-dfe6db97ba0a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:12 devstack sudo[108197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17
Sep 08 16:55:12 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:13 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17" returned: 0 in 0.348s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73ffd9eb-7eec-4d39-963e-eba90b92a449(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[47931bfe-ef38-4cd9-a845-40fa31ab9ef5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:13 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449
Sep 08 16:55:13 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:13 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449" returned: 0 in 0.338s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:13 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17
Sep 08 16:55:13 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:13 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17" returned: 0 in 0.324s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:13 devstack sudo[108212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17
Sep 08 16:55:13 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:14 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449.704199ab-bef8-493a-a47a-a6f03fd0ef17" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-704199ab-bef8-493a-a47a-a6f03fd0ef17" released by "_delete_snapshot" :: held 1.328s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-73ffd9eb-7eec-4d39-963e-eba90b92a449" released by "delete_snapshot" :: held 1.351s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Created reservations ['cb252b56-1a8c-41b7-87e7-f741d2aaacc3', '3820cdf5-edac-479e-8198-520eba1922a3', 'f04fd311-dbab-4e37-9bb0-9d4d27b7636b', '48896da5-eb40-40af-b649-d6f09a8618cd'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ae0eeeb1-ccf9-4d90-abfa-e2c700a4b67d tempest-ProjectMemberTests-1709291775 None] Lock "cinder-704199ab-bef8-493a-a47a-a6f03fd0ef17-delete_snapshot" released by "delete_snapshot" :: held 1.473s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-73ffd9eb-7eec-4d39-963e-eba90b92a449-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-73ffd9eb-7eec-4d39-963e-eba90b92a449-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-73ffd9eb-7eec-4d39-963e-eba90b92a449" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-73ffd9eb-7eec-4d39-963e-eba90b92a449" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fc9efd-36f4-4e79-89d1-d6f88d72eca9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:15 devstack sudo[108216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449
Sep 08 16:55:15 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:15 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449" returned: 0 in 0.335s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:15 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449
Sep 08 16:55:15 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:15 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-73ffd9eb-7eec-4d39-963e-eba90b92a449" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-73ffd9eb-7eec-4d39-963e-eba90b92a449" released by "delete_volume" :: held 0.617s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Created reservations ['a88d0dfa-e94e-47ec-8bdb-b433e300bf2c', '1e03ccf9-0f21-4c7d-8a1a-f2f163819cb4', '6f7098d6-cb12-408f-8182-191237756fb1', 'aca6bd5c-2853-4456-9e1a-3cf941ceed6a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:15 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:15 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:15 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.237s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:15 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:55:15 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-bd9edd9f-f141-4524-b83c-3d0f7837c9d1 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-73ffd9eb-7eec-4d39-963e-eba90b92a449-delete_volume" released by "delete_volume" :: held 1.028s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (0e15d9ae-b292-42fd-8c69-680f15da82de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bc6fef-b2b2-4189-8d04-98f8703b7d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bc6fef-b2b2-4189-8d04-98f8703b7d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-675251223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6541ec3d-939c-47c0-824a-8fa9cc0889ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:16Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866bc286-0970-490b-9729-6a24136ca560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866bc286-0970-490b-9729-6a24136ca560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad864f9-8ae3-4da5-a299-bc6f56c94854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad864f9-8ae3-4da5-a299-bc6f56c94854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6541ec3d-939c-47c0-824a-8fa9cc0889ad', 'volume_name': 'volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fc0c26-9d2d-49df-8cc6-05b1907fc5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fc0c26-9d2d-49df-8cc6-05b1907fc5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606523af-4ef2-4381-bb4e-7a40b83f67f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:16 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Volume 6541ec3d-939c-47c0-824a-8fa9cc0889ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad', 'volume_size': 1}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-675251223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6541ec3d-939c-47c0-824a-8fa9cc0889ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be79709cd3374273a573fc8e62507a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:16Z,use_quota=True,user_id='b9154127b1844709b59f62aa96773920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Creating volume 6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:16 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:16 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:16 devstack sudo[108227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad 1073741824
Sep 08 16:55:16 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:17 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad 1073741824" returned: 0 in 0.407s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:17 devstack sudo[108233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad
Sep 08 16:55:17 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:17 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad" returned: 0 in 0.247s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606523af-4ef2-4381-bb4e-7a40b83f67f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff54d1e1-dffe-4c73-8752-fb13496323d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:17 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Volume volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad (6541ec3d-939c-47c0-824a-8fa9cc0889ad): created successfully
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff54d1e1-dffe-4c73-8752-fb13496323d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Flow 'volume_create_manager' (0e15d9ae-b292-42fd-8c69-680f15da82de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:17 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-fd8912a9-c3ce-4166-b718-71447ecbdf50 tempest-ProjectMemberTests-1709291775 None] Created volume successfully.
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Creating offline snapshot 83f3bd48-3aea-4138-8bc0-a1947aab5e4f of volume 6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[8498205d-d745-4f27-9a19-f67d9bf4f2b0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:17 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:17 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad
Sep 08 16:55:17 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:18 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad" returned: 0 in 0.366s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:18 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f 1G
Sep 08 16:55:18 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:18 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f 1G" returned: 0 in 0.371s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:18 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f
Sep 08 16:55:18 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:18 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f" returned: 0 in 0.281s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:18 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f is being set with open permissions: ugo+rw
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:18 devstack sudo[108251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f
Sep 08 16:55:18 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:18 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:18 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:18 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.info
Sep 08 16:55:18 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:19 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.info" returned: 0 in 0.240s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:19 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.info is being set with open permissions: ugo+rw
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:19 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.info
Sep 08 16:55:19 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:19 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.info" returned: 0 in 0.230s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:19 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-9513a1d1-dfc5-4ece-a728-38ed3da0dc40 tempest-ProjectMemberTests-1709291775 None] Create snapshot completed successfully
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-83f3bd48-3aea-4138-8bc0-a1947aab5e4f-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-83f3bd48-3aea-4138-8bc0-a1947aab5e4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-6541ec3d-939c-47c0-824a-8fa9cc0889ad" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-6541ec3d-939c-47c0-824a-8fa9cc0889ad" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-83f3bd48-3aea-4138-8bc0-a1947aab5e4f" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-83f3bd48-3aea-4138-8bc0-a1947aab5e4f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Deleting offline snapshot 83f3bd48-3aea-4138-8bc0-a1947aab5e4f of volume 6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] snapshot_file for this snap is: volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a68f3b8-da0d-49e3-9d1c-3e64755cb3d2]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:19 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:20 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f
Sep 08 16:55:20 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:20 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f" returned: 0 in 0.346s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5df1e9f-37c1-42d6-97ae-fab282f1f55b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:20 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad
Sep 08 16:55:20 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:20 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:20 devstack sudo[108270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f
Sep 08 16:55:20 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:20 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f" returned: 0 in 0.322s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:20 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:21 devstack sudo[108275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f
Sep 08 16:55:21 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:21 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:21 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad.83f3bd48-3aea-4138-8bc0-a1947aab5e4f" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-83f3bd48-3aea-4138-8bc0-a1947aab5e4f" released by "_delete_snapshot" :: held 1.332s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-6541ec3d-939c-47c0-824a-8fa9cc0889ad" released by "delete_snapshot" :: held 1.354s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:21 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Created reservations ['de8217fb-2f55-4485-b382-062d585afb54', '3e337190-c44f-49cc-b580-014a9b9f3878', 'dd9cd352-fdb5-4239-a1ac-ae678b96c16c', '010eec58-4188-4703-9a2d-440267a34159'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:21 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Delete snapshot completed successfully.
Sep 08 16:55:21 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-498a0922-7c67-48fc-aba8-620bb78f7c73 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-83f3bd48-3aea-4138-8bc0-a1947aab5e4f-delete_snapshot" released by "delete_snapshot" :: held 1.476s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-6541ec3d-939c-47c0-824a-8fa9cc0889ad-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-6541ec3d-939c-47c0-824a-8fa9cc0889ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "cinder-quobyte-6541ec3d-939c-47c0-824a-8fa9cc0889ad" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-6541ec3d-939c-47c0-824a-8fa9cc0889ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[592b4cec-22a8-4a72-a4a7-075b8964561c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:22 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad
Sep 08 16:55:22 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:22 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:22 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad
Sep 08 16:55:22 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:22 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-6541ec3d-939c-47c0-824a-8fa9cc0889ad" returned: 0 in 0.244s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-quobyte-6541ec3d-939c-47c0-824a-8fa9cc0889ad" released by "delete_volume" :: held 0.640s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Created reservations ['b71109be-bbd0-4ce2-abd6-5344e8464eec', '4eef96fb-3769-49d7-9056-18076f1b2473', '7fe3679f-bb00-4881-8d29-79156f44f622', '6ad23877-59c1-462a-b669-eb52d942fd18'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:22 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:22 devstack sudo[108286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:22 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:23 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:23 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.234s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:23 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:23 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Deleted volume successfully.
Sep 08 16:55:23 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-6dfbec67-3b38-41ca-964b-6faaf4828a33 tempest-ProjectMemberTests-1709291775 None] Lock "cinder-6541ec3d-939c-47c0-824a-8fa9cc0889ad-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (10413d04-f4eb-4b79-a5b1-1aa4209d6593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ab7075-0558-4a42-af27-58737e31f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ab7075-0558-4a42-af27-58737e31f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884783891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dd6e2a-e01f-4ed7-ba0d-c6428b699401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:26Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8683119-c39c-4443-ae7e-2a61d944cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8683119-c39c-4443-ae7e-2a61d944cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a28ad7-a613-4a83-b54f-59213805ee07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a28ad7-a613-4a83-b54f-59213805ee07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01dd6e2a-e01f-4ed7-ba0d-c6428b699401', 'volume_name': 'volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2e6c29-6a85-4490-8759-462a534fce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb2e6c29-6a85-4490-8759-462a534fce0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e04759-7719-400b-be26-4ff56f499c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:26 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Volume 01dd6e2a-e01f-4ed7-ba0d-c6428b699401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401', 'volume_size': 1}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1884783891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dd6e2a-e01f-4ed7-ba0d-c6428b699401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:26Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Creating volume 01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:26 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:26 devstack sudo[108290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 1073741824
Sep 08 16:55:26 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:26 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:26 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 1073741824" returned: 0 in 0.393s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:27 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401
Sep 08 16:55:27 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:27 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" returned: 0 in 0.229s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e04759-7719-400b-be26-4ff56f499c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d7b03a-a5c7-43ac-8a9d-d88c46ba98c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:27 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Volume volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 (01dd6e2a-e01f-4ed7-ba0d-c6428b699401): created successfully
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d7b03a-a5c7-43ac-8a9d-d88c46ba98c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (10413d04-f4eb-4b79-a5b1-1aa4209d6593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:27 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-35b93f68-ba9f-4d47-826a-40e2d9c81d5a tempest-ProjectReaderTests-153876553 None] Created volume successfully.
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Creating offline snapshot af39429f-52d5-4623-81b9-54e5c084adf7 of volume 01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4d1952-11d7-47d9-8c49-2ce4a801a6c3]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:27 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:27 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401
Sep 08 16:55:27 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:28 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" returned: 0 in 0.338s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:28 devstack sudo[108304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 1G
Sep 08 16:55:28 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:28 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 1G" returned: 0 in 0.346s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:28 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7
Sep 08 16:55:28 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:28 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7" returned: 0 in 0.272s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:28 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 is being set with open permissions: ugo+rw
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:28 devstack sudo[108315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7
Sep 08 16:55:28 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:28 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7" returned: 0 in 0.267s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:28 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:28 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.info
Sep 08 16:55:28 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:29 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.info" returned: 0 in 0.235s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:29 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.info is being set with open permissions: ugo+rw
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:29 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.info
Sep 08 16:55:29 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:29 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.info" returned: 0 in 0.226s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.761s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:29 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e49bbfed-5120-48fa-ba67-481b284c0e7a tempest-ProjectReaderTests-153876553 None] Create snapshot completed successfully
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-af39429f-52d5-4623-81b9-54e5c084adf7-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Lock "cinder-af39429f-52d5-4623-81b9-54e5c084adf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-af39429f-52d5-4623-81b9-54e5c084adf7" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-af39429f-52d5-4623-81b9-54e5c084adf7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Deleting offline snapshot af39429f-52d5-4623-81b9-54e5c084adf7 of volume 01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] snapshot_file for this snap is: volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d8f39-1e8e-4d3b-b892-2d6aef02ad1a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:29 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:30 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7
Sep 08 16:55:30 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:30 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7" returned: 0 in 0.338s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa230b1-df2b-4453-bcc7-a3f6d8e8f9f5]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:30 devstack sudo[108329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401
Sep 08 16:55:30 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:30 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" returned: 0 in 0.336s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:30 devstack sudo[108334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7
Sep 08 16:55:30 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:30 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7" returned: 0 in 0.316s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:30 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:30 devstack sudo[108341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7
Sep 08 16:55:30 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:31 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:31 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401.af39429f-52d5-4623-81b9-54e5c084adf7" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-af39429f-52d5-4623-81b9-54e5c084adf7" released by "_delete_snapshot" :: held 1.301s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" released by "delete_snapshot" :: held 1.322s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:31 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Created reservations ['1ebae07e-1e8f-4055-96ad-e8123dc58734', '43bccc01-1bc5-42fa-bdf5-6baed1860ad3', '56709d21-5124-4b31-93aa-1b21cc7153eb', '1fd588cd-1e51-40bf-bb49-0d9b30e81b6f'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:31 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Delete snapshot completed successfully.
Sep 08 16:55:31 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-0da08f31-078a-4bd8-84f4-ec381f327ffa tempest-ProjectReaderTests-153876553 None] Lock "cinder-af39429f-52d5-4623-81b9-54e5c084adf7-delete_snapshot" released by "delete_snapshot" :: held 1.445s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-01dd6e2a-e01f-4ed7-ba0d-c6428b699401-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Lock "cinder-01dd6e2a-e01f-4ed7-ba0d-c6428b699401-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" acquired by "delete_volume" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b13f3-55c8-4663-9b3f-48875dfc10ba]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:32 devstack sudo[108345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401
Sep 08 16:55:32 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:32 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:32 devstack sudo[108350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401
Sep 08 16:55:32 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:32 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-01dd6e2a-e01f-4ed7-ba0d-c6428b699401" released by "delete_volume" :: held 0.619s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Created reservations ['0d0afe40-fdc9-484a-9781-ab8936d74701', '4646aa8b-f4a5-4d86-b685-4a21e3a61221', '7ccf8a88-e878-40fb-ba91-6de554b7f3f0', '0f2cc9f9-53b6-497e-a670-b63169f600b8'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:32 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:32 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:32 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:33 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.232s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:33 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Deleted volume successfully.
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-435311ca-8b59-483a-8d29-eab14fdee7ac tempest-ProjectReaderTests-153876553 None] Lock "cinder-01dd6e2a-e01f-4ed7-ba0d-c6428b699401-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (14a6ce0a-7e5c-48ae-9316-7aa74595fe20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46dd542-b243-4039-8824-5581b19b15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46dd542-b243-4039-8824-5581b19b15ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610671322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb260d42-2eab-454e-8e9a-826357368331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:34Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457bf0de-692a-4323-9eba-c819908e3b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457bf0de-692a-4323-9eba-c819908e3b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4851b96f-94c1-4dae-8ca3-da92a23b75f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4851b96f-94c1-4dae-8ca3-da92a23b75f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb260d42-2eab-454e-8e9a-826357368331', 'volume_name': 'volume-cb260d42-2eab-454e-8e9a-826357368331', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fdfd12-71b4-4910-bf98-28558384442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fdfd12-71b4-4910-bf98-28558384442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54db823-6714-401a-b183-6c5936de9a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:33 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Volume cb260d42-2eab-454e-8e9a-826357368331: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb260d42-2eab-454e-8e9a-826357368331', 'volume_size': 1}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1610671322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb260d42-2eab-454e-8e9a-826357368331,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:34Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Creating volume cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:33 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:33 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:33 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 1073741824
Sep 08 16:55:33 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:34 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 1073741824" returned: 0 in 0.404s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:34 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331
Sep 08 16:55:34 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:34 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331" returned: 0 in 0.229s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54db823-6714-401a-b183-6c5936de9a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb260d42-2eab-454e-8e9a-826357368331', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07afc64-a553-469d-b370-a11610b2e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:34 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Volume volume-cb260d42-2eab-454e-8e9a-826357368331 (cb260d42-2eab-454e-8e9a-826357368331): created successfully
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07afc64-a553-469d-b370-a11610b2e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (14a6ce0a-7e5c-48ae-9316-7aa74595fe20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:34 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-4e2f8b67-28d1-49be-98ed-aac4da33f1b6 tempest-ProjectReaderTests-153876553 None] Created volume successfully.
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Creating offline snapshot ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d of volume cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08920da-cce7-46d3-9eb6-cb8baae9d893]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:34 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:34 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331
Sep 08 16:55:34 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:35 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331" returned: 0 in 0.332s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:35 devstack sudo[108370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d 1G
Sep 08 16:55:35 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:35 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d 1G" returned: 0 in 0.364s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb260d42-2eab-454e-8e9a-826357368331 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:35 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb260d42-2eab-454e-8e9a-826357368331 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d
Sep 08 16:55:35 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:35 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb260d42-2eab-454e-8e9a-826357368331 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" returned: 0 in 0.266s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:35 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d is being set with open permissions: ugo+rw
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:35 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d
Sep 08 16:55:35 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:35 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:35 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:35 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.info
Sep 08 16:55:35 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:36 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.info" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:36 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.info is being set with open permissions: ugo+rw
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:36 devstack sudo[108387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.info
Sep 08 16:55:36 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:36 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.info" returned: 0 in 0.223s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.722s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:36 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-6532e488-6ede-4cc5-ac5c-eb5e53e3232e tempest-ProjectReaderTests-153876553 None] Create snapshot completed successfully
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Lock "cinder-ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-cb260d42-2eab-454e-8e9a-826357368331" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-cb260d42-2eab-454e-8e9a-826357368331" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Deleting offline snapshot ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d of volume cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] snapshot_file for this snap is: volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc18423e-f4e0-4ec4-b135-9cd00b438516]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:36 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:37 devstack sudo[108390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d
Sep 08 16:55:37 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:37 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" returned: 0 in 0.343s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb260d42-2eab-454e-8e9a-826357368331(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc26947-a068-4424-be37-ce737c26ff81]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:37 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331
Sep 08 16:55:37 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:37 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331" returned: 0 in 0.342s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:37 devstack sudo[108400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d
Sep 08 16:55:37 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:37 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" returned: 0 in 0.338s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:37 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:37 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d
Sep 08 16:55:37 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:38 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:38 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331.ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d" released by "_delete_snapshot" :: held 1.335s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-cb260d42-2eab-454e-8e9a-826357368331" released by "delete_snapshot" :: held 1.360s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:38 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Created reservations ['4cc02b1d-879e-4405-8e4d-1c5d5b6cdcc0', '9b5b517e-e9b6-4b0a-9155-ce22d4cee34d', 'd53b422d-2b9c-49a0-b924-804f32cac1ec', '1cf797f1-d0ce-4f8f-9676-86222e23dd5e'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:38 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Delete snapshot completed successfully.
Sep 08 16:55:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e66c5bac-87aa-43c4-9d75-6b9772916161 tempest-ProjectReaderTests-153876553 None] Lock "cinder-ed29bad7-7a3b-45d0-a4f4-0f7afcfa479d-delete_snapshot" released by "delete_snapshot" :: held 1.484s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:38 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-cb260d42-2eab-454e-8e9a-826357368331-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Lock "cinder-cb260d42-2eab-454e-8e9a-826357368331-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-cb260d42-2eab-454e-8e9a-826357368331" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-cb260d42-2eab-454e-8e9a-826357368331" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[35887f84-30ea-44da-95b9-7000ead7e219]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:39 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331
Sep 08 16:55:39 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:39 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331" returned: 0 in 0.334s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:39 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331
Sep 08 16:55:39 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:39 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-cb260d42-2eab-454e-8e9a-826357368331" returned: 0 in 0.232s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-cb260d42-2eab-454e-8e9a-826357368331" released by "delete_volume" :: held 0.617s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Created reservations ['84e4ba55-e4db-416c-899e-c85b9ea222bd', 'e7d510ac-c403-4ceb-a131-be90fc51498b', '95814f02-b763-4631-933b-325a3c899102', 'b5f8dbbb-f1c1-4509-a1fa-8a1d57937443'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:39 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:39 devstack sudo[108416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:39 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:40 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:40 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Deleted volume successfully.
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-07e7e58a-a8b5-45a0-a4a3-1859d34fa15e tempest-ProjectReaderTests-153876553 None] Lock "cinder-cb260d42-2eab-454e-8e9a-826357368331-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (4ff09f3d-e620-4dc1-8588-6c9cd826f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b55a566-3813-4ab0-b7df-914c0975d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b55a566-3813-4ab0-b7df-914c0975d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140639695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94f0c43-840f-48bc-9049-c9fe1799d448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:41Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd43c494-a782-4749-bdd7-23cd9c0c2dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd43c494-a782-4749-bdd7-23cd9c0c2dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e362b4a-527e-4ab7-9bc6-ef2cce62d124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e362b4a-527e-4ab7-9bc6-ef2cce62d124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94f0c43-840f-48bc-9049-c9fe1799d448', 'volume_name': 'volume-c94f0c43-840f-48bc-9049-c9fe1799d448', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ad8a08-9744-4843-bfc7-98d4ed152a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3ad8a08-9744-4843-bfc7-98d4ed152a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02279e08-d3df-485e-a4bd-05fae49fd5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:40 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Volume c94f0c43-840f-48bc-9049-c9fe1799d448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94f0c43-840f-48bc-9049-c9fe1799d448', 'volume_size': 1}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140639695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94f0c43-840f-48bc-9049-c9fe1799d448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:41Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Creating volume c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:40 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:40 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:40 devstack sudo[108419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 1073741824
Sep 08 16:55:40 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:41 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 1073741824" returned: 0 in 0.400s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:41 devstack sudo[108425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448
Sep 08 16:55:41 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:41 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448" returned: 0 in 0.239s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02279e08-d3df-485e-a4bd-05fae49fd5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94f0c43-840f-48bc-9049-c9fe1799d448', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5354d6-b4e9-4cf5-8ea3-cb727ab78334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:41 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Volume volume-c94f0c43-840f-48bc-9049-c9fe1799d448 (c94f0c43-840f-48bc-9049-c9fe1799d448): created successfully
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5354d6-b4e9-4cf5-8ea3-cb727ab78334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (4ff09f3d-e620-4dc1-8588-6c9cd826f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:41 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ac848c95-927f-4bb3-96bb-505b9a5ad964 tempest-ProjectReaderTests-153876553 None] Created volume successfully.
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Creating offline snapshot 2b8e98c0-ed2e-4e29-9586-6b282ff9e488 of volume c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a376a4-bea1-4eb6-9744-dcb01da9a4bb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:41 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:41 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448
Sep 08 16:55:41 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:42 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448" returned: 0 in 0.350s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:42 devstack sudo[108433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 1G
Sep 08 16:55:42 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:42 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 1G" returned: 0 in 0.360s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94f0c43-840f-48bc-9049-c9fe1799d448 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:42 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94f0c43-840f-48bc-9049-c9fe1799d448 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488
Sep 08 16:55:42 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:42 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94f0c43-840f-48bc-9049-c9fe1799d448 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488" returned: 0 in 0.278s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:42 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 is being set with open permissions: ugo+rw
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:42 devstack sudo[108443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488
Sep 08 16:55:42 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:42 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488" returned: 0 in 0.236s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:42 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:42 devstack sudo[108446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.info
Sep 08 16:55:43 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:43 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.info" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:43 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.info is being set with open permissions: ugo+rw
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:43 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.info
Sep 08 16:55:43 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:43 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.info" returned: 0 in 0.231s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.774s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:43 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-0f7e2b97-99fc-4e3d-bfb8-383ee98ba3f7 tempest-ProjectReaderTests-153876553 None] Create snapshot completed successfully
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-2b8e98c0-ed2e-4e29-9586-6b282ff9e488-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Lock "cinder-2b8e98c0-ed2e-4e29-9586-6b282ff9e488-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-c94f0c43-840f-48bc-9049-c9fe1799d448" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-c94f0c43-840f-48bc-9049-c9fe1799d448" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-2b8e98c0-ed2e-4e29-9586-6b282ff9e488" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-2b8e98c0-ed2e-4e29-9586-6b282ff9e488" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Deleting offline snapshot 2b8e98c0-ed2e-4e29-9586-6b282ff9e488 of volume c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] snapshot_file for this snap is: volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc0160f-b96c-42e6-b7f2-2720723576a8]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:43 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:43 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488
Sep 08 16:55:43 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:44 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94f0c43-840f-48bc-9049-c9fe1799d448(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497b91a-87ce-4be6-81b3-e59f241511cb]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:44 devstack sudo[108458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448
Sep 08 16:55:44 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:44 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448" returned: 0 in 0.346s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:44 devstack sudo[108463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488
Sep 08 16:55:44 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:44 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488" returned: 0 in 0.312s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:44 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:44 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488
Sep 08 16:55:44 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:45 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:45 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448.2b8e98c0-ed2e-4e29-9586-6b282ff9e488" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-2b8e98c0-ed2e-4e29-9586-6b282ff9e488" released by "_delete_snapshot" :: held 1.308s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-c94f0c43-840f-48bc-9049-c9fe1799d448" released by "delete_snapshot" :: held 1.327s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:45 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Created reservations ['9157d669-7e4c-483c-bb03-8c2c7890bce7', '1c028ecb-ffe6-47fc-a482-9d20ca33d691', 'b278f983-46a5-4f57-8dca-4882fa0a0550', '7b2b2079-7aff-49fc-b124-0ca872bd9e2d'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:45 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Delete snapshot completed successfully.
Sep 08 16:55:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-ed95cff6-7b18-4871-a6b4-597a26601e05 tempest-ProjectReaderTests-153876553 None] Lock "cinder-2b8e98c0-ed2e-4e29-9586-6b282ff9e488-delete_snapshot" released by "delete_snapshot" :: held 1.457s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-c94f0c43-840f-48bc-9049-c9fe1799d448-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:45 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Lock "cinder-c94f0c43-840f-48bc-9049-c9fe1799d448-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-c94f0c43-840f-48bc-9049-c9fe1799d448" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-c94f0c43-840f-48bc-9049-c9fe1799d448" acquired by "delete_volume" :: waited 0.012s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[185bc40b-28a3-495e-8b2a-5699df0d9be0]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:46 devstack sudo[108472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448
Sep 08 16:55:46 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:46 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448" returned: 0 in 0.339s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:46 devstack sudo[108477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448
Sep 08 16:55:46 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:46 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-c94f0c43-840f-48bc-9049-c9fe1799d448" returned: 0 in 0.233s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-c94f0c43-840f-48bc-9049-c9fe1799d448" released by "delete_volume" :: held 0.621s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Created reservations ['6d0d60da-749f-4561-a517-09658ce110d3', 'c45560ed-4fa8-404f-8fac-721ca0e9a280', 'a17ab120-7849-44fd-8766-f9e213414f1b', '3c9dc103-3475-4df3-adf9-903922e68365'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:46 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:46 devstack sudo[108480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:46 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:47 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.245s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:47 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Deleted volume successfully.
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1d0e5018-bec2-422f-8eb5-f3ac4b2fb985 tempest-ProjectReaderTests-153876553 None] Lock "cinder-c94f0c43-840f-48bc-9049-c9fe1799d448-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (8a712c75-071b-4b85-bced-d313d66419ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5934c85e-3220-4e6c-9a53-3030aecc0b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5934c85e-3220-4e6c-9a53-3030aecc0b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485094476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d9ca89-9a8b-413f-a9f1-fc0c9d984c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:47Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06c988c-8b8b-4d65-bb14-a703883e847d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f06c988c-8b8b-4d65-bb14-a703883e847d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06826b7b-7081-4f5e-9761-d501271b3f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06826b7b-7081-4f5e-9761-d501271b3f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d9ca89-9a8b-413f-a9f1-fc0c9d984c63', 'volume_name': 'volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa7ee38-a4da-4164-971b-3b45edafac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa7ee38-a4da-4164-971b-3b45edafac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681be152-6e17-44d1-bf79-c84d4ee25f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:47 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Volume 78d9ca89-9a8b-413f-a9f1-fc0c9d984c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63', 'volume_size': 1}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485094476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d9ca89-9a8b-413f-a9f1-fc0c9d984c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:47Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Creating volume 78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:47 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:47 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 1073741824
Sep 08 16:55:47 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:47 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:47 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 1073741824" returned: 0 in 0.408s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:48 devstack sudo[108488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63
Sep 08 16:55:48 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:48 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" returned: 0 in 0.240s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (681be152-6e17-44d1-bf79-c84d4ee25f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe36520-f264-40cc-ac95-2ae4a30c76d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:48 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Volume volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 (78d9ca89-9a8b-413f-a9f1-fc0c9d984c63): created successfully
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afe36520-f264-40cc-ac95-2ae4a30c76d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (8a712c75-071b-4b85-bced-d313d66419ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:48 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f245b481-e282-4c85-be78-2c5683e3e526 tempest-ProjectReaderTests-153876553 None] Created volume successfully.
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Creating offline snapshot aaafc398-33da-4155-acea-bdc802d4077b of volume 78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9989fe07-4d20-49ce-886d-4bf80de22b16]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:48 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:48 devstack sudo[108491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63
Sep 08 16:55:48 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:49 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" returned: 0 in 0.356s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:49 devstack sudo[108496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b 1G
Sep 08 16:55:49 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:49 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b 1G" returned: 0 in 0.372s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:49 devstack sudo[108501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b
Sep 08 16:55:49 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:49 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b" returned: 0 in 0.332s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:49 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b is being set with open permissions: ugo+rw
Sep 08 16:55:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:49 devstack sudo[108507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b
Sep 08 16:55:49 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:49 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:49 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b" returned: 0 in 0.251s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:50 devstack sudo[108510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.info
Sep 08 16:55:50 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:50 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.info" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:50 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.info is being set with open permissions: ugo+rw
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:50 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.info
Sep 08 16:55:50 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:50 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.info" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:50 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-063c91db-1d8e-4864-b9be-f6f9902af99b tempest-ProjectReaderTests-153876553 None] Create snapshot completed successfully
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-aaafc398-33da-4155-acea-bdc802d4077b-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Lock "cinder-aaafc398-33da-4155-acea-bdc802d4077b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-aaafc398-33da-4155-acea-bdc802d4077b" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-aaafc398-33da-4155-acea-bdc802d4077b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Deleting offline snapshot aaafc398-33da-4155-acea-bdc802d4077b of volume 78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] snapshot_file for this snap is: volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c57634-44c1-4efa-87ce-b935d0307ad1]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:50 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:50 devstack sudo[108516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b
Sep 08 16:55:50 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:51 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b" returned: 0 in 0.363s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[4305acea-b023-46bf-929b-e2b5afe06d8a]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:51 devstack sudo[108521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63
Sep 08 16:55:51 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:51 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" returned: 0 in 0.346s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:51 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b
Sep 08 16:55:51 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:51 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b" returned: 0 in 0.333s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:51 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:51 devstack sudo[108532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b
Sep 08 16:55:51 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:52 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63.aaafc398-33da-4155-acea-bdc802d4077b" returned: 0 in 0.243s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-aaafc398-33da-4155-acea-bdc802d4077b" released by "_delete_snapshot" :: held 1.378s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" released by "delete_snapshot" :: held 1.401s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Created reservations ['0e5ad702-59ce-44f7-aa6d-b36bee5b8c30', 'ae43eae9-c4a8-430a-a7ef-e8b5e645cb7f', '996e667e-d16c-4062-9603-f1f73fcb8995', 'f2ea17b6-01af-446d-9114-b332be2377c9'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:52 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Delete snapshot completed successfully.
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d3b0b2a9-3c17-4166-af7c-ceee61d5bcc7 tempest-ProjectReaderTests-153876553 None] Lock "cinder-aaafc398-33da-4155-acea-bdc802d4077b-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Lock "cinder-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:52 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f995249-3a0c-4aab-bdc8-88d53ae0c072]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:53 devstack sudo[108535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63
Sep 08 16:55:53 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:53 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:53 devstack sudo[108540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63
Sep 08 16:55:53 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:53 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" returned: 0 in 0.246s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63" released by "delete_volume" :: held 0.640s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Created reservations ['1776f825-553f-44aa-8872-23840738e2fd', '4c3455bf-eff7-49d3-8c27-4f282ac0f947', '986b4d2d-f924-45a3-a4ee-2d2554bc592d', '1c608274-a037-4022-aedf-fccf0f92bc2a'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:53 devstack sudo[108543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:53 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:53 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.251s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:53 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:54 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Deleted volume successfully.
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-e5c8280f-7f81-4a0d-8315-67847bc7f476 tempest-ProjectReaderTests-153876553 None] Lock "cinder-78d9ca89-9a8b-413f-a9f1-fc0c9d984c63-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (d3e2fb4d-e344-4b23-aa76-07fd75b9965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29860a80-0683-4108-ace4-230b7564b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29860a80-0683-4108-ace4-230b7564b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116014581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde03b9a-d2f9-45ad-bf84-e373cc931de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:54Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37f86be-1024-4e9b-b609-e82d0c0225d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37f86be-1024-4e9b-b609-e82d0c0225d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c831c32-ee00-418c-880c-0e80fb3f2c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c831c32-ee00-418c-880c-0e80fb3f2c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde03b9a-d2f9-45ad-bf84-e373cc931de7', 'volume_name': 'volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b484dfc-7ef7-44c9-8b3a-b1c21d9146e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b484dfc-7ef7-44c9-8b3a-b1c21d9146e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331cd5d4-5d97-4eaa-a8b8-ef54769cf781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:54 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Volume dde03b9a-d2f9-45ad-bf84-e373cc931de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7', 'volume_size': 1}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2116014581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde03b9a-d2f9-45ad-bf84-e373cc931de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08444d6f10c4f12a8b1cb56fc3095e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:55:54Z,use_quota=True,user_id='ab3b3980b83e43109c85d9f1d973a13f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Creating volume dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:55:54 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:54 devstack sudo[108547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 1073741824
Sep 08 16:55:54 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:54 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:54 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 1073741824" returned: 0 in 0.411s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:55 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7
Sep 08 16:55:55 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:55 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7" returned: 0 in 0.249s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331cd5d4-5d97-4eaa-a8b8-ef54769cf781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3c30c0-59d0-4824-b614-19c94063c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:55:55 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Volume volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 (dde03b9a-d2f9-45ad-bf84-e373cc931de7): created successfully
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a3c30c0-59d0-4824-b614-19c94063c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Flow 'volume_create_manager' (d3e2fb4d-e344-4b23-aa76-07fd75b9965f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:55:55 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-598260cd-628c-49c9-adcb-26cb32ddb345 tempest-ProjectReaderTests-153876553 None] Created volume successfully.
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Creating offline snapshot a7c45550-bbe2-4eb9-91af-2be093ec6953 of volume dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[920670d9-44e2-4afc-874b-3889e2ed8ae4]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:55 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:55 devstack sudo[108555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7
Sep 08 16:55:55 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:56 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7" returned: 0 in 0.365s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 1G {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:56 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 1G
Sep 08 16:55:56 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:56 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 1G" returned: 0 in 0.403s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:56 devstack sudo[108566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953
Sep 08 16:55:56 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:56 devstack sudo[108568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:55:56 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:56 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 -F qcow2 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953" returned: 0 in 0.293s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:56 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 is being set with open permissions: ugo+rw
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:56 devstack sudo[108574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953
Sep 08 16:55:56 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:56 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.270s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG oslo_service.periodic_task [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] Running periodic task VolumeManager._thread_info {{(pid=87505) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread count: 28 {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 08 16:55:56 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-35f516cf-bcbc-4fdb-afdf-542b728a985a None None] thread info: [<_MainThread(MainThread, started 134364962295936)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134364848907456)>, <Thread(Thread-3 (stat_writer), started daemon 134364848718464)>, <Thread(Rabbit-heartbeat, started daemon 134364845661824)>, <Thread(Thread-5 (_runner), started daemon 134364845766400)>, <Thread(Thread-7 (_runner), started daemon 134364845792448)>, <Thread(fd_logger, started daemon 134364843855168)>, <Thread(privsep_reader, started daemon 134364843855296)>, <Thread(tpool_thread_0, started daemon 134364838299328)>, <Thread(tpool_thread_1, started daemon 134364829906624)>, <Thread(tpool_thread_2, started daemon 134364821513920)>, <Thread(tpool_thread_3, started daemon 134364813121216)>, <Thread(tpool_thread_4, started daemon 134364804728512)>, <Thread(tpool_thread_5, started daemon 134364796335808)>, <Thread(tpool_thread_6, started daemon 134364787943104)>, <Thread(tpool_thread_7, started daemon 134364779550400)>, <Thread(tpool_thread_8, started daemon 134364771157696)>, <Thread(tpool_thread_9, started daemon 134364762764992)>, <Thread(tpool_thread_10, started daemon 134364754372288)>, <Thread(tpool_thread_11, started daemon 134364745979584)>, <Thread(tpool_thread_12, started daemon 134364737586880)>, <Thread(tpool_thread_13, started daemon 134364729194176)>, <Thread(tpool_thread_14, started daemon 134364720801472)>, <Thread(tpool_thread_15, started daemon 134364712408768)>, <Thread(tpool_thread_16, started daemon 134364704016064)>, <Thread(tpool_thread_17, started daemon 134364695623360)>, <Thread(tpool_thread_18, started daemon 134364687230656)>, <Thread(tpool_thread_19, started daemon 134364678821568)>] {{(pid=87505) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 08 16:55:57 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953" returned: 0 in 0.267s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:57 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.info
Sep 08 16:55:57 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:57 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.info" returned: 0 in 0.246s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:57 devstack cinder-volume[87505]: WARNING cinder.volume.drivers.remotefs [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.info is being set with open permissions: ugo+rw
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.info {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:57 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.info
Sep 08 16:55:57 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:57 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.info" returned: 0 in 0.246s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:55:57 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-f4fa378d-004c-4078-ada7-f389044deee7 tempest-ProjectReaderTests-153876553 None] Create snapshot completed successfully
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-a7c45550-bbe2-4eb9-91af-2be093ec6953-delete_snapshot" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Lock "cinder-a7c45550-bbe2-4eb9-91af-2be093ec6953-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-dde03b9a-d2f9-45ad-bf84-e373cc931de7" by "delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-dde03b9a-d2f9-45ad-bf84-e373cc931de7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-a7c45550-bbe2-4eb9-91af-2be093ec6953" by "_delete_snapshot" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-a7c45550-bbe2-4eb9-91af-2be093ec6953" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Deleting offline snapshot a7c45550-bbe2-4eb9-91af-2be093ec6953 of volume dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] snapshot_file for this snap is: volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 {{(pid=87505) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a18764-0efb-4344-9cee-0a660458f6c6]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:57 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:57 devstack sudo[108584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953
Sep 08 16:55:57 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:58 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953" returned: 0 in 0.344s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87505) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[619d8890-097e-4286-ad06-adf4998be80b]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:58 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7
Sep 08 16:55:58 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:58 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7" returned: 0 in 0.355s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:58 devstack sudo[108594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953
Sep 08 16:55:58 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:58 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953" returned: 0 in 0.329s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:58 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:55:58 devstack sudo[108599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953
Sep 08 16:55:58 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:55:59 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7.a7c45550-bbe2-4eb9-91af-2be093ec6953" returned: 0 in 0.238s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-a7c45550-bbe2-4eb9-91af-2be093ec6953" released by "_delete_snapshot" :: held 1.345s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-dde03b9a-d2f9-45ad-bf84-e373cc931de7" released by "delete_snapshot" :: held 1.365s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Created reservations ['503c9cb2-0ab3-4923-a4cc-90831fe1c3c5', '50837639-69c3-4521-a488-41093c2d8274', 'a1673986-d155-4d68-85ea-56332078418a', 'e6d02213-023a-44a1-8d96-5dc77edbd9f9'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:55:59 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Delete snapshot completed successfully.
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-92b77a8b-02d7-4f43-92c0-5fa2db1ef7e6 tempest-ProjectReaderTests-153876553 None] Lock "cinder-a7c45550-bbe2-4eb9-91af-2be093ec6953-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-dde03b9a-d2f9-45ad-bf84-e373cc931de7-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Lock "cinder-dde03b9a-d2f9-45ad-bf84-e373cc931de7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Acquiring lock "cinder-quobyte-dde03b9a-d2f9-45ad-bf84-e373cc931de7" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:55:59 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-dde03b9a-d2f9-45ad-bf84-e373cc931de7" acquired by "delete_volume" :: waited 0.013s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f89c4c-445e-44f5-84c0-ff9f3a0d9cc4]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:00 devstack sudo[108602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7
Sep 08 16:56:00 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:00 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7" returned: 0 in 0.335s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:00 devstack sudo[108607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7
Sep 08 16:56:00 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:00 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-dde03b9a-d2f9-45ad-bf84-e373cc931de7" returned: 0 in 0.238s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Lock "cinder-quobyte-dde03b9a-d2f9-45ad-bf84-e373cc931de7" released by "delete_volume" :: held 0.624s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Created reservations ['6412ebab-448c-43b9-9fe2-93aab318437f', 'f52ffd19-86f6-4c85-be11-2132d338dee8', '75c6873e-d733-499b-83d1-a935d1831894', 'dc559140-e20b-4987-837c-ee840349e0c3'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:00 devstack sudo[108646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:56:00 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:00 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.241s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:00 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:56:00 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Deleted volume successfully.
Sep 08 16:56:01 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-1b766bf4-24e2-4d41-8cd2-efa898b30c70 tempest-ProjectReaderTests-153876553 None] Lock "cinder-dde03b9a-d2f9-45ad-bf84-e373cc931de7-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (35c1de76-79e5-44ae-b296-c767add2ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c4c878-dc82-4eb0-86ad-a1fe1d641a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c4c878-dc82-4eb0-86ad-a1fe1d641a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1774633223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5115e0e5-440e-4d60-8e40-5ba5112ff85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:05Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f96a9db-42f5-4a26-99ee-6e3d85ec07c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f96a9db-42f5-4a26-99ee-6e3d85ec07c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c1734f-a924-4a9e-8911-181215107089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c1734f-a924-4a9e-8911-181215107089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5115e0e5-440e-4d60-8e40-5ba5112ff85d', 'volume_name': 'volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0811b7dd-4904-455e-96a8-880bfca39475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0811b7dd-4904-455e-96a8-880bfca39475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8cb23f-7580-4d3d-b8a8-18cd7fd4519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:04 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Volume 5115e0e5-440e-4d60-8e40-5ba5112ff85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d', 'volume_size': 1}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1774633223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5115e0e5-440e-4d60-8e40-5ba5112ff85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:05Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Creating volume 5115e0e5-440e-4d60-8e40-5ba5112ff85d {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:56:04 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:56:04 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:04 devstack sudo[108651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d 1073741824
Sep 08 16:56:04 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:05 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d 1073741824" returned: 0 in 0.408s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:05 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d
Sep 08 16:56:05 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:05 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d" returned: 0 in 0.250s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8cb23f-7580-4d3d-b8a8-18cd7fd4519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c0c6e5-75ba-4375-8dcf-25a1037878da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:05 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Volume volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d (5115e0e5-440e-4d60-8e40-5ba5112ff85d): created successfully
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c0c6e5-75ba-4375-8dcf-25a1037878da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (35c1de76-79e5-44ae-b296-c767add2ad44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:05 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-e15d7312-ec2e-4cd8-9fef-199425789329 tempest-ProjectReaderTests-1232205830 None] Created volume successfully.
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-5115e0e5-440e-4d60-8e40-5ba5112ff85d-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-5115e0e5-440e-4d60-8e40-5ba5112ff85d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-quobyte-5115e0e5-440e-4d60-8e40-5ba5112ff85d" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-5115e0e5-440e-4d60-8e40-5ba5112ff85d" acquired by "delete_volume" :: waited 0.015s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[670ae923-48b3-4905-81a8-4147bcbe25d9]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:56:05 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:06 devstack sudo[108660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d
Sep 08 16:56:06 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:06 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d" returned: 0 in 0.356s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:06 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d
Sep 08 16:56:06 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:06 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-5115e0e5-440e-4d60-8e40-5ba5112ff85d" returned: 0 in 0.268s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-5115e0e5-440e-4d60-8e40-5ba5112ff85d" released by "delete_volume" :: held 0.659s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Created reservations ['9629cdbb-9b92-4612-b07c-eb685f6bbc8f', '8305ef70-ea92-4819-81eb-9358f7a35572', '6caf795a-4c51-4c58-ad9e-03b2d1569ccb', '3dacc28d-838b-4055-82b8-b14f84cba037'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:06 devstack sudo[108668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:56:06 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:06 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.252s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:56:06 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Deleted volume successfully.
Sep 08 16:56:06 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d900b0b5-e2ee-4472-b7dd-748fcd3fb091 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-5115e0e5-440e-4d60-8e40-5ba5112ff85d-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (f8c650ff-c7d7-4fef-9dc7-08bc6ff1d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f25eef-3866-4ce8-9d03-3415a7e90bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f25eef-3866-4ce8-9d03-3415a7e90bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992315485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25497285-d29b-415b-b4fe-497b47525ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:07Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c35534-59e8-4638-bc6c-53336d2fefff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c35534-59e8-4638-bc6c-53336d2fefff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8ed052-a70d-43f7-b0b2-01d7dce66f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8ed052-a70d-43f7-b0b2-01d7dce66f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25497285-d29b-415b-b4fe-497b47525ff2', 'volume_name': 'volume-25497285-d29b-415b-b4fe-497b47525ff2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30325c5-f1c0-4aea-870d-127ffe48330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30325c5-f1c0-4aea-870d-127ffe48330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42667deb-477c-4d14-87fa-5a2d000c205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:07 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Volume 25497285-d29b-415b-b4fe-497b47525ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25497285-d29b-415b-b4fe-497b47525ff2', 'volume_size': 1}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992315485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25497285-d29b-415b-b4fe-497b47525ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:07Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Creating volume 25497285-d29b-415b-b4fe-497b47525ff2 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:56:07 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:07 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2 1073741824
Sep 08 16:56:07 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:07 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2 1073741824" returned: 0 in 0.397s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:07 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:07 devstack sudo[108676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2
Sep 08 16:56:07 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:08 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2" returned: 0 in 0.241s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42667deb-477c-4d14-87fa-5a2d000c205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25497285-d29b-415b-b4fe-497b47525ff2', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22f0eae-9174-4ec7-80af-bcdf2cf2107b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:08 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Volume volume-25497285-d29b-415b-b4fe-497b47525ff2 (25497285-d29b-415b-b4fe-497b47525ff2): created successfully
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f22f0eae-9174-4ec7-80af-bcdf2cf2107b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (f8c650ff-c7d7-4fef-9dc7-08bc6ff1d94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:08 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c2368059-2957-4a50-af1f-ef9f632728a0 tempest-ProjectReaderTests-1232205830 None] Created volume successfully.
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-25497285-d29b-415b-b4fe-497b47525ff2-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Lock "cinder-25497285-d29b-415b-b4fe-497b47525ff2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-quobyte-25497285-d29b-415b-b4fe-497b47525ff2" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-25497285-d29b-415b-b4fe-497b47525ff2" acquired by "delete_volume" :: waited 0.017s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e59a4be-782a-45f8-8a7f-709b5605ad87]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:08 devstack sudo[108679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2
Sep 08 16:56:08 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:08 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2" returned: 0 in 0.374s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:08 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:08 devstack sudo[108684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2
Sep 08 16:56:08 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:09 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-25497285-d29b-415b-b4fe-497b47525ff2" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-25497285-d29b-415b-b4fe-497b47525ff2" released by "delete_volume" :: held 0.653s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Created reservations ['abf74aee-2dde-4126-a73f-fa9f7c8b8bdd', '10a16ef1-7924-458f-828e-0d54ab38746d', '6501698f-29b2-4e7f-b199-870a73aaf127', 'e497a350-bff3-42c4-af70-144c5dc5f7e0'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:09 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:56:09 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:09 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.260s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:56:09 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Deleted volume successfully.
Sep 08 16:56:09 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-d16b8783-12ea-4ec5-8042-a790e88fabce tempest-ProjectReaderTests-1232205830 None] Lock "cinder-25497285-d29b-415b-b4fe-497b47525ff2-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (9245591b-0076-4f67-96e5-d0f818d269ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada41408-b3f5-4eb5-8c3e-e8240a42363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada41408-b3f5-4eb5-8c3e-e8240a42363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378371661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2601e9a4-c719-4a14-ae5a-d7e595928018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:10Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2eb223-8a45-4108-b9af-f484732cbf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2eb223-8a45-4108-b9af-f484732cbf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350e64cb-1d28-47c4-bde7-5a72533aeb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350e64cb-1d28-47c4-bde7-5a72533aeb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2601e9a4-c719-4a14-ae5a-d7e595928018', 'volume_name': 'volume-2601e9a4-c719-4a14-ae5a-d7e595928018', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a1209-eb9a-4fa6-9dd8-15288401ecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a1209-eb9a-4fa6-9dd8-15288401ecc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87be2274-2507-4d58-a54b-e940dd324903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:10 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Volume 2601e9a4-c719-4a14-ae5a-d7e595928018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2601e9a4-c719-4a14-ae5a-d7e595928018', 'volume_size': 1}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378371661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2601e9a4-c719-4a14-ae5a-d7e595928018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:10Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Creating volume 2601e9a4-c719-4a14-ae5a-d7e595928018 {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:56:10 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:10 devstack sudo[108696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018 1073741824
Sep 08 16:56:10 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:10 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018 1073741824" returned: 0 in 0.403s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=106,cinder:INSERT=45,cinder:DELETE=10,cinder:UPDATE=138 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:10 devstack sudo[108702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018
Sep 08 16:56:10 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:10 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018" returned: 0 in 0.246s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87be2274-2507-4d58-a54b-e940dd324903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2601e9a4-c719-4a14-ae5a-d7e595928018', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2115da10-6383-470c-9cf5-729cd17d9d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:10 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Volume volume-2601e9a4-c719-4a14-ae5a-d7e595928018 (2601e9a4-c719-4a14-ae5a-d7e595928018): created successfully
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2115da10-6383-470c-9cf5-729cd17d9d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:10 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (9245591b-0076-4f67-96e5-d0f818d269ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:10 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-c5d0d1c1-dd66-4ee0-8b69-b02bb3b9f0f3 tempest-ProjectReaderTests-1232205830 None] Created volume successfully.
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-2601e9a4-c719-4a14-ae5a-d7e595928018-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Lock "cinder-2601e9a4-c719-4a14-ae5a-d7e595928018-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-quobyte-2601e9a4-c719-4a14-ae5a-d7e595928018" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-2601e9a4-c719-4a14-ae5a-d7e595928018" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a085bd9-8f65-4528-9379-b1823a408d3c]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:11 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018
Sep 08 16:56:11 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:11 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018" returned: 0 in 0.337s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:11 devstack sudo[108710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018
Sep 08 16:56:11 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:11 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-2601e9a4-c719-4a14-ae5a-d7e595928018" returned: 0 in 0.235s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-2601e9a4-c719-4a14-ae5a-d7e595928018" released by "delete_volume" :: held 0.607s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Created reservations ['af7215ed-0738-487c-a49b-618cdd3d9f9a', '07aea390-823e-4c68-a270-f3dea7323488', '3fd38fb4-a380-49d5-bfc4-3f6d3fbc21c2', 'cf6f7c2e-2adf-401d-8a6f-902cce896505'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:11 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:11 devstack sudo[108713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:56:11 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:12 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:56:12 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Deleted volume successfully.
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=160,cinder:SELECT=122,cinder:INSERT=38,cinder:DELETE=16 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-7d57a1db-0862-4ba0-ae40-6d9b4452188d tempest-ProjectReaderTests-1232205830 None] Lock "cinder-2601e9a4-c719-4a14-ae5a-d7e595928018-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87505) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (2c7f3c73-0e47-4bdd-9b96-f127cf32845e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3cea8b-4f49-4738-84a3-6aaa6c1d0fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da3cea8b-4f49-4738-84a3-6aaa6c1d0fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-689486928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e9f6df-24d1-45e8-9007-ac094d11029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:13Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3992bfe-3741-415b-85e8-f0d11bf15c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3992bfe-3741-415b-85e8-f0d11bf15c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0810a1fd-302f-4896-8e72-626434bf4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0810a1fd-302f-4896-8e72-626434bf4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e9f6df-24d1-45e8-9007-ac094d11029d', 'volume_name': 'volume-f3e9f6df-24d1-45e8-9007-ac094d11029d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85a64b1-ff3a-4a3c-8bc4-86cd63414144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85a64b1-ff3a-4a3c-8bc4-86cd63414144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a0b763-294a-4226-9752-97db47f4286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:12 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Volume f3e9f6df-24d1-45e8-9007-ac094d11029d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e9f6df-24d1-45e8-9007-ac094d11029d', 'volume_size': 1}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a34410a5520>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-08T14:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-689486928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3e9f6df-24d1-45e8-9007-ac094d11029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6f4853beb4cfe9610b5df78f1a25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T14:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T14:56:13Z,use_quota=True,user_id='88bf3001d2f646e686af6889d0e3a782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae4ed44b-9d30-4cbc-8a23-9035516a4da2),volume_type_id=ae4ed44b-9d30-4cbc-8a23-9035516a4da2)}" {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.remotefs [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Creating volume f3e9f6df-24d1-45e8-9007-ac094d11029d {{(pid=87505) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Selected osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444 as target Quobyte volume. {{(pid=87505) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 08 16:56:12 devstack cinder-volume[87505]: INFO cinder.volume.drivers.remotefs [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] casted to osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444
Sep 08 16:56:12 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d 1073741824 {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:12 devstack sudo[108716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d 1073741824
Sep 08 16:56:12 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:13 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d 1073741824" returned: 0 in 0.423s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:13 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d
Sep 08 16:56:13 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:13 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d" returned: 0 in 0.242s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'} {{(pid=87505) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a0b763-294a-4226-9752-97db47f4286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e9f6df-24d1-45e8-9007-ac094d11029d', 'volume_size': 1}' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f130f57-4749-4d9a-a896-8e1a77108286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 08 16:56:13 devstack cinder-volume[87505]: INFO cinder.volume.flows.manager.create_volume [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Volume volume-f3e9f6df-24d1-45e8-9007-ac094d11029d (f3e9f6df-24d1-45e8-9007-ac094d11029d): created successfully
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f130f57-4749-4d9a-a896-8e1a77108286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87505) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Flow 'volume_create_manager' (2c7f3c73-0e47-4bdd-9b96-f127cf32845e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87505) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 08 16:56:13 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-7ea56c4d-ca7f-49ac-95ca-22179cd207b8 tempest-ProjectReaderTests-1232205830 None] Created volume successfully.
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-f3e9f6df-24d1-45e8-9007-ac094d11029d-delete_volume" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-f3e9f6df-24d1-45e8-9007-ac094d11029d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "cinder-quobyte-f3e9f6df-24d1-45e8-9007-ac094d11029d" by "delete_volume" {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-f3e9f6df-24d1-45e8-9007-ac094d11029d" acquired by "delete_volume" :: waited 0.014s {{(pid=87505) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG oslo.privsep.daemon [-] privsep: reply[c330c2a0-05d5-4ffe-bda6-b33286ffb124]: (4, 'qcow2') {{(pid=88671) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 08 16:56:13 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:13 devstack sudo[108725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d
Sep 08 16:56:13 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:14 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d" returned: 0 in 0.355s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:14 devstack sudo[108731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d
Sep 08 16:56:14 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:14 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d/volume-f3e9f6df-24d1-45e8-9007-ac094d11029d" returned: 0 in 0.253s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-quobyte-f3e9f6df-24d1-45e8-9007-ac094d11029d" released by "delete_volume" :: held 0.644s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG cinder.quota [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Created reservations ['38746fbe-4d59-48a2-9b36-f40614facf83', 'e1a27d1a-baac-429d-b69e-3fc98d1e3ab4', 'f45ca1eb-9387-40f0-917f-609040e34765', '16d8fe07-867e-4fdf-889a-97292bda35b4'] {{(pid=87505) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444': None} {{(pid=87505) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG cinder.volume.drivers.quobyte [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b673ec8b-04ed-4acd-9644-e28336ec0444'] {{(pid=87505) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.lockutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87505) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 08 16:56:14 devstack sudo[108734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d
Sep 08 16:56:14 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 08 16:56:14 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG oslo_concurrency.processutils [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/04eb0f8063c375f574395e70c797832d" returned: 0 in 0.255s {{(pid=87505) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG cinder.manager [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Notifying Schedulers of capabilities ... {{(pid=87505) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 08 16:56:14 devstack cinder-volume[87505]: INFO cinder.volume.manager [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Deleted volume successfully.
Sep 08 16:56:14 devstack cinder-volume[87505]: DEBUG cinder.coordination [None req-90514edf-8c09-43bb-9b40-0b90f66b4b50 tempest-ProjectReaderTests-1232205830 None] Lock "cinder-f3e9f6df-24d1-45e8-9007-ac094d11029d-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87505) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 08 16:56:24 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 08 16:56:24 devstack cinder-volume[87505]: DEBUG dbcounter [-] [87505] Writing DB stats cinder:UPDATE=24,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87505) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}